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ABSTRACT 

This report presents the results of two field-based 
experimental studies to determine the effects of questioning 
techniques on student achievement and attitudes. The first study was 
done to determine what student learning outcomes are affected by 
teachers* use of probing and redirection techniques in classroom 
discussions. Another purpose of the experiment was to determine the 
„x^elative effect on student learning of teachers' questions delivered 
in both oral and written formats. The second study was conducted to 
determine what student learning outcomes are affected by variations 
in teachers' use of higher cognitive questions. These questions 
require the student to state predictions, solutions, explanations or 
opinions, expanding on information presented in the curriculum and 
interpreting it in his own way. This experiment was designed to test 
the belief that use of higher cognitive questions is important for 
developing students' ability to think. The finding of both studies 
was that discussion following critical viewing and/or reading of 
curriculum materials was effective in promoting student achievement. 
Writing responses to questions appeared to develop knowledge 
acquisition as effectively as participation in discussion. However, 
written exercises seemed less effective for improving higher 
cognitive response ability than oral discussion in which the 
students' responses are probed and redirected by the teacher. The 
methodology of the experiment is described in detail, and five 
appendixes list the statistical results of the two studies. (JD) 



Documents acquired by ERIC include many infomal unpublished materials not available firom other sources. ERIC makes every 
effort to obtain the best copy available. Nevertheless, items of marginal reproducibility are often encountered and this affects the 
quality of the microfiche and hardcopy reproductions ERIC makes available via the ERIC Document Reproduction Service (EDRS). 
EDRS is not responsible for the quality of the original doctiment. Reproductions supplied by EDRS are the best that can be made from 
si nal. 

ERIC „ ..^ 



TEACHER EDUCATION 

PUBLICATION SERIES 



THE EFFECTS OF TEACHER USE OF QUESTIONING TECHNIQUES 
ON STUDENT ACHIEVEMENT AND ATTITUDES 
Volume I. Final Report 

Gall, M. D., Ward, B. A., Berliner, D. C. , Cahen, L. S., 
Crown, K. A., Elashoff, J. D., Stanton, G. S., and 
Winne, P. H. 



us OEPARTMENTOF HEALTH 
EDUCAT;C?< A WELFARE ' 
NATIO^^AL INSTITUTE OF 
eOJCATION 
THIS DOCUMENT HAS BEEN REPBO 
OUCED EXACTLY AS REcirVEO FROM 
InNr'.r'S:^ 0« ORGAN.ZAT.ON OR.G?N 
Mrrn r^^^"''^ °' OPINIONS 
STATED DO NOV NtCCSSARlLY REPRE- 

^^.'^/O'^'^'C'ALNAT.ONAL INSTITUTE OF 
EDUCATION POSITION OR POLICV 



REPORT A76-2 



FAR WEST LABORATORY FOR EDUCATIONAL RESEARCH; AND DEVELOPMENT 

1855 Folsom Street, San Francisco, California, 94103, (415) 565-3000 



11/ ) FAR WEST LABORATORY 

^ f:OK KDLICATIONAL RESF.ARCH AND DEVELOPMENT 



PROGRAMS IN TEACHING 



Beatrice A. Ward, Associate Laboratory Director for Teaching 
David C. Berliner, Associate Laboratory Director for Research 
Meredith D. Gall, Research Unit Director 



THE EFFECTS OF TEACHER USE OF QUESTIONING TECHNIQUES 
ON STUDENT ACHIEVEMENT AND ATTITUDES 

Volume I. Final Report 



Meredith D. Gall 
Beatrice A. Ward 
David C. Berliner 
Leonard S. Cahen 
Kenneth A. Crown 
Janet D. Elashoff 
George S. Stanton 
Phil ip H. Winne / 



.March 1976 



The work reported herein was supported by the National Institute 
of Education, Department of Health, Education, and Welfare, 
Contract No. NE-C-00-3-0108. The opinions expressed in this 
F lication do not necessarily reflect the position or policy 
ot the National Institute of Education and no official endorse- 
ment by the National Institute of Education should be inferred. 



3 



FOLSOM STREET *- SAN FRANCISCO. CALIFORNIA 94103 (415) 565-3000 



ACKNOWLEDGEMENTS 



The experiments reported in the four volumes of this report represent 
an. ambitious, largerscale attempt to determine the effects of teacher 
questioning techniques on student achievement and attitudes. Nine treat- 
ments were administered to approximately 700 students distributed across 
24 classrooms in two school districts. Eleven achievement tests and attitude 
scales, measuring 32 different variables, were developed and administered 
to each student. Data collection and experimentation extended over a 
period of three months. 

This type of large-scale research requires the cooperation and talents 
of many people, whom we wish to acknowledge here. First, we express our 
appreciation to the assistant superintendents of Novato and San Lorenzo 
School -Districts located in the San Francisco Bay Area. They supported 
our research goals and recruited participants. We also are endebted to 
the school principals and teachers in these districts who permitted us to 
work with their students. They gave excellent cooperation in all phases 
of the project. Our experimenter-teachers found it rewarding to work w^ith 
the Stulents in these districts. The students were well -motivated, co- 
operative, and understood the requirements of the experimental procedures. 
The school district participants are not identified by name in order to. 
preserve confidentiality of data source. 

Some features of the research design were based on earlier work done 
by the senior author in the field of classroom questioning techniques. The 
design was further developed in collaboration with Kenneth Crown and with 
Philip Winne of the Stanford Center for Research and Development in Teaching. 



4 



Dr. Winne was involved in all phases of the project, from inception to 
completion, and is responsible for much of whatever scientific rigor it 
may possess. David Berlint^r and Beatrice Ward made liiajpr cpntributions 
in the conceptualization of the research variables-^.tc^ be investigated and 
provided administrative support throughout the project. Dr. Ward also 
assisted with the writing of this report. Dr. BerMner was especially 
helpful in recruiting staff and consultants with specialized research 
skills. Janet Elashoff of the University of California at Los Angeles 
considerably improved the early versions of the research by recasting 
it in the form of a Latin square design. Others who reviewed and 
contributed to the design were Robert Heath of Nomos Institute, Stephen 
Klein of Systems Development Corporation, Leonard Marascuilo 
of the University of California at Berkeley ^ Barak Rosenshine of the 
University of Illinois, James Shaver of Utah State University and Samuel 
Messick of Educational Testing Service. 

The ecology curriculum was developed primarily by Kenneth Crown, 
Lorraine Thorn, Beatrice Ward, and the senior author. Consultant support 
was provided 'by Fred Rosenau of the Far West Laboratory, Chester Lawson 
of the Lawrence Hall of Science, and Frank Ryan of the University of 
California at Riverside. Peggy Cling of Daniel Webster Elementary School 
in San Francisco and Peter Baldo of Castro Valley Elementary School 
graciously permitted the staff to pilot-test the materials in their 
classrooms. 

The development of the achievement and attitudinal measures was the 
responsibility of the senior author, with substantial assistance provided 
by Robert Heath and Mark Nielsen of the Nomos Institute. Gerrie Smith 
carried out the item analyses needed to refine the measures. Kenneth 
Crown pilot-tested the measures and participated in their revision. 



EKLC 



5 



Marilyn Madsen was responsible for recruitment of the participating 
schools. She, along with Kenneth Crown and Lorraine Thorn, coordinated 
data collection and administration of-the treatments,,., They deserve credit 
for accomplishing a high level of treatment fidelity, relatively complete 
data collection, and cooperation of all participants in this study. 

Twelve teachers, selected and trained bi< Lorraine Thorn and Kenneth 
Crown, administered the treatments. Their professional competence, 
enthusiasm, and cooperation was essential to the success of the study. 
We wish to acknowledge each^of^them--Sandra Cohen, Nancy Cook, Marqaret 
Cross, Maisie Dea, Esther Kay Homsey, Martha Karatz, Constance McBrier, 
Patricia Mulford, James Nettleton, Wilma Parker, Diane Racine, and 
Norma *Shul tz. 

The data analysis phase of the study was directed by Leonard Cahen 
and the senior author. Philip Winhe and George Stanton of the Stanford- 
Center for Research and Development in Teaching and Janet Elashoff pro- ^ 
vided statistical consultation. In addition, George Stanton was responsible 
for data management and all the computer work used to generate the analyses 
reported in this volume and in Volume IV. His heroic dedication to these 
tasks was essential to the success of this phase of the study. 

Another major effort in this phase was the scoring of the subjective 
measures. of student achievement whi,ch were administered in the two experi- 
ments. A team of five raters performed this task with skill and patience: 
Linda Davis, Audrey Ferber, Keith Jones, Carol Rice, snd William Sees. 
Keith Jones and Carol Rice were particularly helpful in collaborating with 
the senior author to develop and refine the rating procedures. Dan Johnson 
was responsible for developing rating procedures used to analyze audiotapes 
of treatment sessions for fidelity of treatment. Williai^ Sees also partici- 
pated in this project. 

- 6 



iv 



The writing of the final report (Volume I) is primarily the work of the 
senior author, Beatrice Ward and Philip Winne. Other contributors were 
Janet Elashoff, who wrote the section on analysis of variance procedures; 
Robert Heath who described the research design; and Kenneth Crown, who 
wrote the description of the curriculum and treatment procedures. It 
should be emphasized, though, that the report reflects the ideas and con- 
tributions of the entire project staff. 

The authors were assisted in report preparation by Carol Rice and 
Dan Johnson, who org^ized-^thej^ar^ sections which appear in the 
four volumes, performedv^SMPPlemehtary data analyses, and prepared taBTes — 

and figures. . - ^ - 

The research staff was fortunate to enjoy the exceptional talents of 
Ursula Hoffman, the project secretary. We are endebted to her for helping 
to maintain staff morale and for keeping track o^ :ver-mul tiplying details. 
Also, she designed, typed, and organized the production of all materials 
used in the study. We wish to acknowledge, too, Carolyn Amable and Janet 
Weyrick, who provided secretarial support and Marion Lentz who provided 
additional editorial and proofreading support. 

Meredith D. Gall 
March* 1976 ': 



/ 



7 



TABLE OF .CONTENTS 



Page 

Acknowledgements 

Table of Contents v 

List of Tables vii 

List of Figures xv 

Abstract xvi^ 

SECTION I - INTRODUCTION _„ „ . I 

Chapter One - Purpose "I 

Chapter Two - Background ' 6 

.Strategy for Studying the Effects of Teaching Skills 6 

Teaching Skills Included in the Research 7 

Overview of Questioning Studies 13 
SECTION II - STUDY I 

Chapter Three - Methodology of Study I 16 

Treatments ^6 

Curriculum * 29 

Students and Teachers 37 
Instrumentation 

Research Design 61 

Statistical Analysis 67 

Chapter Four - Study I Results 75 

Achievement Measures -77 

Attitude Measures 91 

Status Variables 99 
Summary 

1^ * 

- 8 



ERIC 



Append 
Append 
Append 
Append 



X B 
X C 
X D 



Appendix E 



Page 



SECTION III - STUDY II 

Chcipter Five - Methodology of Study II 104 
Treatments 

Curriculum *^^4 

Students and Teachers 114 

Instrumentation 116 - 

Research" Design of Study II 127 

Statistical Analysis 130 

Chapter Six - Study II Results 134 

Achievement Measures ^^36 

Attitude Measures 145 

Status Variables . - - . 1^° 

Summary 1^^ 
SECTION IV - DISCUSSION OF FINDINGS 

Chapter Seven - Discussions of Findings 152 

Strengths of Research Design 153 

Limitations of Research Design 157 

Treatment Effects 1^1 

Secondary Questions 1^^ 

Implications for Use of Minicourses 1 and 9 J' 179 

Implications for Future Research 181 

References ^84 



x A 188 



191 
203 
215 
250 



VI 



TABLES 

Page 

1 . Study I Treatments 24 

2. Study I Teacher Behavior Patterns in Discussion Treatments 26 

3. Study I Average Length of Discussion Treatment Sessions 28 

4. Objectives of the Experimental Curriculum Unit 32 

5. Study I Mean Reading Scores of Students 38 

6. Study XAchievement Measures ~ - ^2 

7. Study I Attitude Scales 43 

8. Study I Derivation of , Oral Test Items 47 
•9. Study I Percentage of Oral Tests Having Pre-Post Indicator 



17. Study I Treatment Meass and Planned Comparisons of Measures 
Ability, Achievement, and Attendance 

18. Study I Latin Square Means for Variables Exhibiting 
Square Effect 

19. Study I Analysis of Variance of Attitude Scale Scores 

20. Study I Treatment Means and Planned Comparisons of Attitude 
Measures 



49 
50 

52 



10. Study I Comparison of Oral Test Posttest Ratings for 
"Post" Indicator Present versus "Post" Indicator Absent 

11. Study I Derivation of Essay Test Items 

12. Study I Comparison of Question-Generating Test (Oral) 
Posttest Ratings for "Post" Indicator Present versus "Post" 
Indicator Absent ^° 

13. Studies I and II Latin Square Design 63 

14. Study I Composition of Squares 

15. Study I Summary of Statistics Used in Adjusting Post- 
treatment Variables 

16. Study I Analysis of Variance Summary for Measures of Ability, 
Achievement, and Attendance 



82 

90 
92 

94 



10 



21. Study I Average Ratings Per Item of Treatment-Specific 
Attitude Scales 

22. Study II Treatments 

23. -Study II Teacher Behavior Patterns in Discussion Treatments 

24. Study II Average Length of Discussion Treatment Sessions 

25. Study II Mean Reading Scores of Students 

26. Study II Achievement Measures 

27. Study II Attitude Scales 

28. Study II Percentage of Oral Tests Having Pre-Post Indicator 

29. Study II Comparison of Oral Test Posttest Ratings for "Post" 
Indicator Present versus "Post" Indicator Absent 

30. Study II Derivation of Essay Test Items 

31. Study II Comparison of Question-Generating Test (Oral) 
Posttest Ratings for "Post" Indicator Present versus "Post" 
Indicator Absent 

32. Study II Composition of Squares 

33. Study II Summary of Statistics Used in Adjusting Post- 
treatment Variables 

34. Study II Analysis of Variance Summary for Measures of 
Ability, Achievement, and Attendance 

35. Study II Treatment Means and Planned Comparisons of Measures 
of Ability, Achievement, and Attendance 

36. Study II Analysis of Variance of Attitude Scale Scores 

37. Study II Treatment Means and Planned Comparisons of 
Attitude Measures 

APPENDIX A 

A-1 Objectives and Skills of Minicourse 1, Effective Questioning 
Elementary Level 

A-2 Objectives and Skills of Minicourse 9, Higher Cognitive 
Questioning 



11 



Page 

APPENDIX B 

B-1 Study I Correlation Matrix of Ecology Information Subtests 192 

B-2 Study I Alpha Coefficients and Standard Errors of Measurement 

of Ecology Information Subtests 193 



B-3 Study I Correlation Matrix of Oral Test Variables 
B-4 Study I Correlation Matrix of Essay Test Variables 



B-12 Study I Correlation Matrix of Ecology Unit Opinions Subscales 

B-13 Study I Alpha Coefficients and Standard Errors of Measurement 
of Ecology Unit Opinion Subscales 

B-1 4 Study I Correlation Matrix of Ecology Discussion Attitude 
Subscales 

B-1 5 Study I Alpha Coefficients and Standard Error of Measurement 
of Ecology Discussion Attitude Subscales 

B-1 6 Study I Alpha Coefficient and Standard Error of Measurement 
of Ecology Art Project Scale 



APPENDIX C 

C-1 Study II Correlation Matrix of Ecology Information Subtests^ 

C-2 Study II Alpha Coefficients and Standard Errors of Measurement 
of Ecology Information Subtests 



194 
194 



B-5 Study I Correlation Matrix of Question-Generating Test 

-Variables (Paper and Pencil Measure) 195 

B-6 Study I Intraclass Correlation Coefficients for Question- ' _ 

Generating Test Variables (Paper and Pencil Measure) 196 

B-7 Study I Correlation Matrix of Question-Generating Test 

Variables (Oral Measure) 196 

B-8 Study I Correlation Matrix of Word Association Subscales 197 

B-9 Study I Alpha Coefficients and Standard Errors of Measurement 

of Word Association Subscales , 198 

B-in Study I Correlation Matrix of Gall-Crown Discussion 

Attitude Subscales - 199 

B-11 Study I Alpha Coefficients and Standard Errors of Measurement 

of Gall-Crown Discussion Attitude Subscales 199 



200 
200 
201 
201 
202 

204 
205 



Rir 



X 

Page 

C-3 Study II Correlation Matrix of Oral Test Variables 206 
C-4 Study II Correlation Matrix of Essay Test Variables 



C-8 Study II Correlation Matrix of Word Association Subscales 

C-9 Study II Alpha Coefficients and Standard Errors of Measurement 
of Word Association Subscales 

C-10 Study II Correlation Matrix of Gall -Crown Discussion Attitude 
Subscales 



C-13 Study II Alpha Coefficients and Standard Errors of Measurement 
of Ecology Unit Opinions Subscales 

C-14 Study II Correlation Matrix of Ecology Discussion Attitude 
Subscales 



D-3 Ecology Informat 
Study I Descript 

D-4 Ecology Informati 



206 



C-5 Study II Correlation Matrix of Question-Generating Test 

Variables (Paper and Pencil Measure) 207 

C-6 Study II Intraclass Correlation Coefficients for Question- 
Generating Test Variables (Paper and Pencil Measure) -^08 

C-7 Study II Correlation Matrix of Question-Generating Test 

Variables (Oral Measure) 208 



209 
210 
211 



C-11 Study II Alpha Coefficients and Standard Errors of Measurement 
of Gall-Crown Discussion Attitude Subscales 

C-12 Study II Correlation Matrix of Ecology Unit Opinions Subscales 212 

212 



213 



C-15 Study II Alpha Coefficients and Standard Errors of Measurement 

of Ecology Discussion Attitude Subscales '^'•^ 

C-16 Study II Alpha Coefficient and Standard Error of Measurement 
of Ecology Art Project Scale 



APPENDIX D 

D-1 Comprehensive Test of Basic Skills (Vocabulary, Comprehension, 

and Total Reading Score), Study I Descriptive Statistics 216 

D-2 Ecology Information Test (Total Scale), Study I 

Descriptive Statistics 217 



on Test (Intentional Scale I) 

ve Statistics 218 

on Test (Incidental Scale I) 
Study"! Descriptive Statistics \ 219 



13 



XI 



Paqe 

D-5 Oral Test (Content Scale), Study I Descriptive Statistics 220 

D-6 Oral Test (Logical Extension Scale), Study I 

Descriptive Statistics 221 

D-7 Essay Test (Essay Test (Content Scale), Study I 
Descriptive Statistics 

D-8 Essay Test (Logical Extension Scale), Study I» 

Descriptive Statistics "3 

D-9 Transfer Test (Content Scale), Study I 
Descriptive Statistics 

D-IO Transfer Test (Logical Extension Scale), Study I 
Descriptive Statistics 

D-11 Question-Generating Test, Paper-and-Pencil Measure (Number of 

Nonpertinent Questions), Study I Descriptive Statistics 226 

D-12 Question-Generating Test, Paper-and-Pencil Measure (Number of 

Pertinent Questions), Study I Descriptive Statistics ZZ7 

D-13 Question-Generating Test, Paper-and-Pencil Measure (Number of 

Specific Questions), Study I -Descriptive Statistics ZZ8 

D-14 Question-Generating Test, Paper-and-Pencil Measure (Number of 

Requests for Rationale), Study I Descriptive Statistics ZZ9 

D-15 Question-Generating Test, Paper-and-Pencil Measure (Quality 

Rating), Study I Descriptive Statistics ZJU 

D-16 Question-Generating Test, Oral Measure (Number of Nonpertinent 

Questions), Study I Descriptive Statistics Z31 

D-17 Question-Generating Test, Oral Measure (Number of Pertinent 

Questions), Study I Descriptive Statistics Z3Z 

D-18 Question-Generating Test, Oral Measure (Quality Rating) 

Study I Descriptive Statistics ZJJ 

D-19 Word Association Scale (Attitude toward Balance of Nature) 
Study I Descr 'tive Statistics 

D-20 Word Association Scale (Attitude toward Ecology) 
Study I Descriptive Statistics 

D-21 Word Association Scale (Attitude toward Wolves) 

Study I Descriptive Statistics "° 

D-22 Word Association Scale (Attitude toward Air Pollution) 
Study I Descriptive Statistics 



14 



234 



ERIC 



xii 



244 



Page 

D-23 Word Association Scale (Attitude toward Alligators) 

Study I Descriptive Statistics 238 

D-24 Word Association Scale (Attitude toward Water Pollution) 

Study I Descriptive Statistics 239 

D-25 Gall-Crown Discussion Attitude Scale (Attitude toward 

Thought Questions), Study I Descriptive Statistics 240 

D-26 Gall -Crown Discussion Scale (Attitude toward Discussion) 

Study I Descriptive Statistics 241 

D-27 Ecology Unit Opinions (Attitude toward Peers) 

Study I Descriptive Statistics 242 

D-28 Ecology Unit Opinions (Attitude toward Ecology Teacher) 

Study I Descriptive Statistics 243 

D-29 Ecology Unit Opinions (Attitude toward Ecology Curriculum) 
Study I Descriptive Statistics 

D-30 Ecology Discussion Attitude Scale (Attitude toward Thought 

Questions), Study I Descriptive Statistics 245 

0-31 Ecology Discussion Attitude Scale (Attitude toward Discussion) 

Study I Descriptive Statistics 246 

D-32 Written Exercise Scale (Attitude toward Thought Questions 
and Written Exercises), Study I Descriptive Statistics- 
Written Exercise Treatment 247 

D-33 Ecology Art Project Scale (Attitude toward Art Projects) 

Study I Descriptive Statistics 248 

D-34 Number of Treatment Sessions Attended, Study I 
Descriptive Statistics 

APPENDIX E 

E-1 Comprehensive Test of Basic Skills (Vocabulary, Comprehension, 

and Total Reading Score), Study II Descriptive Statistics 251 

E-2 Ecology Information Test (Total Scale), Study II 

Descriptive Statistics 252 

E-3 Ecology Information Test (Intentional Scale II), Study II 

Descriptive Statistics 253 

E-4 Ecology Information Test (25% Intentional Scale), Study II 

Descriptive Statistics 254 

15 



249 



ERIC 



E-5 Ecology Information Test (Incidental Scale II), Study II 
Descriptive Statistics 

E-6 Oral Test (Content Scale), Study II Descriptive Statistics 

E-7 Oral Test (Logical Extension Scale), Study II 
Descriptive Statistics 

E-8 Essay Test (Content Scale), Study II Descriptive Statistics 

E-9 Essay Test (Logical Extension Scale), Study II 
Descriptive Statistics 

E-10 Transfer Test (Content Scale), Study II Descriptive Statistics 

E-11 Transfer Test (Logical Extension Scale), Study II 
Descriptive Statistics 

E-12 Question-Generating Test, Paper-and-Pencil Measure (Number of 
Nonpertinent Questions), Study II Descriptive Statistics 

E-13 Question-Generating Test, Paper-and-Pencil Measure (Number of 
Pertinent Questions), Study II Descriptive Statistics 

E-14 Question-Generating Test, Pape vid-Pencil Measure (Number of 
Specific Questions), Study II Descriptive Statistics 

E-15 Question-Generating Test, Paper-and-Pencil Measure (Number of 
Requests for Rationale), Study II Descriptive Statistics 

E-16 Question-Generating Test, Paper-and-Pencil Measure (Quality 
Rating), Study II Descriptive Statistics 

E-17 Question-Generating Test, Oral Measure (Number of Non- 
pertinent Questions), Study II Descriptive Statistics 

E-18 Question-Generating Test, Oral Measure (Number of Pertinent 
Questions), Study II Descriptive Statistics 

E-19 Question-Generating Test, Oral Measure (Quality Rating) 
Study II Descriptive Statistics 

E-20 Word Association Scale (Attitude toward Ecology), Study II 
Descriptive Statistics 

E-21 Word Association Scale (Attitude toward Balance of Nature) 
Study II Descriptive Statistics 

E-22 Word Association Scale (Attitude toward Wolves), Study II 
Descriptive Statistics 

E-23 Word Association Scale (Attitude toward Air Pollution) 
Study II Descriptive Statistics 



16 



xiv 

Page 



E-24 Word Association Scale (Attitude toward Alligators) 

Study II Descriptive Statistics 274 

E-25 Word Association Scale (Attitude toward Water Pollution) 

Study II Descriptive Statistics 275 

E-26 Gall -Crown Discussion Attitude Scale (Attitude toward 

Thought Questions), Study II Descriptive Statistics 276 

E-27 Gall -Crown Discussion Attitude Scale (Attitude toward 

Discussions), Study II Descriptive Statistics 277 

E-28 Ecology Unit Opinions (Attitude toward Peers), Study II 

Descriptive Statistics 278 

E-29 Ecology Unit Opinions (Attitude toward Ecology Teacher) 

Study II Descriptive Statistics 279 

E-30 Ecology Unit Opinions (Attitude toward Ecology Curriculum) 
Study II Descriptive Statistics 

E-31 Ecology Discussion Attitude Scale (Attitude toward Thought 
Questions), Study II Descriptive Statistics 

E-32 Ecology Discussion Attitude-Scale (Attitude toward Discussion) 
Study II Descriptive Statistics 

E-33 Ecology Art Project Scale (Attitude toward Art Projects) 
Study II Descriptive Statistics 

E-34 Number of Treatment Sessions Attended, Study II 
Descriptive Statistics 



280 
281 
282 
283 
284 



17 

o 

ERIC 



Figures 



Continuum of Approaches to the Study of Teac!- ng 

Patterns of Treatment Differences for Ecology Information 
Subtests in Study II 



18 



ABSTRACT 

t 

The Effects of Teacher Use of Questioning' Techniques 
on Student Achievement and Attitudes 



Introduction j 

(' 

This report presents the results of two field-based experimental 
studies of teaching conducted by the staff of the Effective Teacher 
Education Program (ETEP) at the Far West Laboratory for Educational 
Research and Development. ETEP grew out of the Laboratory s earlier 
work in developing a series of skill-training packages for teachers 
called Minicourses. Relatively little is known about the effect of 
the teaching skills in the Minicourses on student learning. Therefore, 
as part of its research effort, ETEP initiated two studies to detennine 
the effects of the questioning techniques presented in Minicourse 1 
(E ffective Questioning— Elementary Level ) and Minicourse 9 (Higher 
Cognitive Questioning ) on student achievement and attitudes. 



Study I 



P urpose 

This experimental study was done to determine what student learning 
outcomes are affected by teachers' use of probing and redirection tech- 
niques in classroom discussions. Probing occurs when the teacher seeks 
to improve the-quality of a student's initial answer to a question by 
asking a follow-up, that is, a "probing," question. Redirection occurs 
when the teacher calls upon more than one student to respond to a question 
already asked of another student. It was hypothesized that probing and 
redirection techniques would promote learning since they provide students 
with practice in organizing their facts and ideas into overt responses. 

Another purpose of the experiment was to determine the relative 

effect on student learning of teachers' questions delivered in oral format 

(discussion) compared with the same questions presented and answered in 
written format. 

Review of Literature 

In his review of research on teacher effectiveness, Rosenshine 
(1971) identified three correlational studies in which the teacher s 
use of probing and redirection following a student's innial answer to 
a question was related to student achievement measures. In two^ these 
studies the specific behaviors of probing and redirection were nfff^eorre- 
lated direc-ly with student achievement; instead, the factors on whicn 
the teacher behaviors were loaded were correlated with student achievement 
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In the third study (Wright and Nuthall , 1970) frequency of redirection had 
a high positive correlation (r=.54) with regressed student achievement 
scores on a fact-recall test. The technique of asking a follow-up ques- 
tion at the same or higher cognitive level (i.e., probing questions) as 
the initial question was only slightly correlated with student achieve- 
ment (r=.20). The present study differs from the Wright and Nuthall study 
in that it investigates probing and redirection techniques experimentally, 
and a variety of learning outcomes are analyzed. 

Treatments 

Five experimental treatments were utilized in Study I. The common 
basis for the five treatments was a specially designed ecology curriculum. 
The curriculum included ten lessons, each requiring an hour of class time, 
and taught at the rate of one per day. The curriculum materials we'-e 
provided to all students, irrespective of treatment- assignment, at :he 
beginning of the class hour. Following viewing and/or reading of materials, 
students formed into their assigned treatment groups. The five treatments 
are as follows: 

Probing and Redirection Treatment . Specially trained teachers 
(called "ecology teachers" here) conducted "scripted 
one for each lesson. These discussions were scripted by the 
researchers to insure"uniformity of treatment across ecology 
teachers and to equate opportunity to learn the curriculum content 
across treatPtent groups. Each discussion consisted of sixteen 
questions, eight of them at the knowledge and comprehension 
levels of Bloom's taxonomy (1956)'; the other eight questions 
were at the analysis, synthesis, and evaluation levels of the 
taxonomy. Since appropriate use of probing and redirection 
techniques depends upon a student's initial response to a question, 
this aspect of the discussions could not be scripted precisely. 
Instead, the ecology teachers were given guidelines concerning 
when and how often to use each technique. 

No Probi ng and Redirection Treatment . This treatment was identi- 
cal to the above, except that the ecology teachers were instructed not 
to use probing and redirection techniques. Instead, they were 
instructed to accept the student's first response to each ques- 
tion, and when appropriate give a model response. This treatment 
required approximately ten less minutes of class time than did 
the Probing and Redirection treatment. 

Filler Activity Treatment . This treatment was identical to the 
No Probing and Redirection Treatment, except that the ecology 
teachers were instructed to engage in. ten minutes of filler 
activity following completion of each discussion. If the Probing 
and Redirection Treatment was found to be superior to the No Prob- 
ing and Redirection Treatment, it could be argued that the con- 
tributing factor was the ten extra minutes of "time on task 
rather than teachers' use of these techniques. The Filler 
Activity Treatment was designed to assess the effect of time on 
task," "independent of probing and redirection, on student 
achievement. 
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Art Activity Treatment . The students in this treatment partici- 
pated in nine sessions of ecology-related art activities. The 
ecology teachers were instructed not to ask any curriculum-related 
questions during these lessons. The time for each art activity 
lesson was approximately equal to that of the Probing and Redirec- 
tion Treatment. 

Written Exercise Treatment . This treatment included the same 
questions as in the discussion treatments. However, students 
were presented the questions in booklet form and asked to write 
the answers in the space provided. The time for each written 
exercise lesson was approximately equal to that of the Probing 
and Redirection Treatment. The ecology teacher was instructed 
not to ask ecology-related questions, but instead only to manage 
the students' work. 

Audiotapes of the three discussion treatments were made for two 
different lessons. Analysis of these audiotapes indicated high fidelity 
of treatment for these treatments. Observations of the Art Activity and 
Written Exercise treatments also indicated that ecology teachers adhered 
closely 'to the requirements of these treatments. 

Student Sample 

Study I was conducted in the San Lorenzo Unified School District, 
San Lorenzo, California. A total of twelve sixth-grade teachers, two in 
each of six schools, volunteered for their students to participate in the 
study. A total of 336 students from these classes were assigned to the 
five experimental treatments. 

Experimental Design 

Four of the treatments— Probing and Redirection, No Probing and Re- 
direction, Filler Activity, and Art Activity— were manipulated in a Latin 
square design. The Written Exercise Treatment was administered as a side- 
experiment outside the Latin square design. Multi-stage randomization 
procedures were used to assign schools and sixth-grade classrooms to 
Latin square blocks, teachers to Latin square blocks, treatments to 
teachers, and students to treatments. Basically, this procedure resulted 
in twelve replications of each treatment. Each replication involved a 
different group of six students and a different ecology teacher. The 
fifth treatment (Written Exercise Treatment) was composed of left-over 
students in each classroom after 24 of their classmates had been randomly 
assigned to the discussion and art activity treatments. 

Measures 

Outcome measures were administered immediately before (pre), 
immediately after (post), or two weeks after (delayed) the treatments. 
The measures included: 
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Verbal Ability . Student's scores of verbal ability from the 
Comprehensive Tests ot Basic Skills (CTBS, Form Q-Level 2) 
were made available by the participating school districts. ^ 
Where appropriate, these scores were used to adjust students 
post and/or delayed scores on the other outcome measures. 

Information Test . This multiple-choice test was administered 
three times to each student: pre, post, and delayed. It was 
designed to measure students' acquisition of factual information 
in the ecology curriculum. The test consists of two subscales to 

measure intentional and incidental learning. Intentional Scale 1 

contains ten items measuring students' ability to recall infor- 
mation covered in the discussion treatments and the Written 
Exercise Treatment. Incidental Scale 1 consists of 17 items 
testing recall of information presented in the curriculum 
materials but not in any of the treatment variations. 

Oral Test . This individually administered test consists of 
six higher-cognitive questions which students answered orally. 
It was given pre and post treatment to all students, and was 
designed to measure students' ability to give plausible, 
reasoned oral responses to higher cognitive questions about the 
ecology curriculum. Since the nature of discussion is to elicit 
oral responses, it was thought that this test might be particularly 
sensitive to differences between the treatments; for example,, in 
the comparison of the discussion treatments with the Written 
Exercise Treatment. This test, like the Essay Test and Transfer 
Test described below, is scored on two scales:, content (the 
number of plausible solutions, predictions, explanations, etc., 
in response to each question) and Logical Extension (the number 
of rationales and if... then extensions in response to each 
question). 

Essay Test . This test, administered pre and post treatment, 
consists of twelve higher cognitive questions for which students 
are to write brief essay answers. Similar to the Oral Test, 
the content of the. Essay Test questions refers to the ecology 
curriculum. 

Tran sfer Test . This test,_^^administered two;.weeks after com- 
pletion of the treatments v consists of nine higher-cognitive 
questions for which students are to write brief essay answers. 
The purpose of this test was to determine whether higher cog- 
nitive response skills learned in the treatments would transfer 
to a new, unstudied curriculum topic— the problem of human 
population explosion. I 

Word Asso ciation Scale . This set of scales, administered pre 
and post treatment, measures students' attitudes toward the 
major topics taught in the ecology curriculum. The measure 
co.nsists of six semantic differential scales, each measuring 
students' attitudes toward a specific ecological topic through 
the use of ten bi-polar adjectives from Osgood's evaluative facuor. 
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Gall -Crown Discussion Attitude Scale . This measure, admin stered 
pre and delayed treatment, consists of two Likert-type subscales: 
one of nineteen items measuring students' attitude toward class 
discussions and one of eleven items measuring students' attitudes 
toward teacher use of higher cognitive questions. 

A measure of attendance was obtained by counting the number of treat- 
ment sessions (possible range, 0-10) at which each student was present. ^ 
Several instruments were administered post treatment to determine students 
attitude toward various aspects of the treatment experience. Also, a 
question-generating test was administered pre and post treatment to 
measure students' ability to generate questions on curriculum-relevant 
topics. Findings based on use of these instruments are presented in 
the full report. 

Data Analysis Plan 

The data in the Latin square design were examined by analysis of 
variance methods. Each of the main factors— discussion treatment, 
classrooms, teachers, and squares— was considered as a fixed effect in 
partitioning the total variance into main effects for treatments, class- 
rooms within squares, teachers within squares, squares, a treatment by 
square interaction, and a residual (error) term. Each dependent variable 
was examined for the possibility of adjusting for pre-experimental 
differences before performing the analyses of variance. 

In addition to examining the data for overall treatment differences, 
several a priori questions pertaining to differences between treatment 
groups were of interest. The following planned comparisons of treatment 
differences were examined: (a) Probing and Redirection versus No Probing 
and Redirection; (b) No Probing and Redirection versus Filler Activity; 
(c) the discussion treatments as a whole (i.e., Probing and Redirection, 
No Probing and Redirection, Filler Activity) versus Art Activity. 

The analysis of variance design does not permit significance- 
testing comparison of the Written Exercise Treatment with the other 
four treatments. However, a basis for deciding whether the Written 
Exercise Treatment means on dependent measures were reliably different 
from other treatment means was provided by computing 95 percent con- r; 
fidence limits for each of tfie-Wrttten Exercise Treatment means^The ^ 
"test" is thus to determine whether any of the discussion or act activil^v .v 
means fall above or below these limits. 

Findings 

The results of the primary data analyses are summarized in Table 1 
(measures of ability, achievement, and attendance) and Table 2 (attitude 
scales). 

The leftmost column lists the names of the dependent variables. 
Each row of the table corresponding to the variable names presents 
information pertaining to that variable only. 
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TABLE 1 



Analysis of Variance Summary for Study I Measyres of 
Ability, Achievement > and Atteridance 



DEPENDEfIT VARIABLE 



Mer of Sess/ons Attended 
CTBS^ - Total Reading 

Ecology Information Test; 
Intentional Scale I, post 
Intentional Scale I» delay 
Incidental Scale I, post 
Incidental Scale I, delay 

Oral Test; 
Content^ post 
Logical Extension, post 

Essay Test; 
Content, post 
Logical Extension, post 

Transfer Test: 
Content, delay 
Logical Extension, delay 

Written Question Generating Test; 
Non-perttnent Questions 
Pertinent Questions 
Specific Questions 
Request for Rationale 
Quality Rating 

Oral Question Generating Test; 
Kon-pertinent Questions 
Pertinent Questions 
Quality Rating 
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F VALUES AND FOR ANALYSIS OF VARIANCE EFFECTS 
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nents 
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direct 


Actlv. 


I 




ment 5 


1 V5 2 


2 vs'3 



Treatments, 
..1>2,3.V8 4' 



,55' 1,74 0.06'' 0,48 0.12 0.68 0,07 



total .rdng. 0,85 5,04* 0.20 2,53* 0.22 

1.12 6,90* 0.19 3,19* 0,21 

2,52, 3,07 0.12 1,61 0.10 

total rdng. 2.46 1.06 0.00 2,38 0.25 



pre .. 
pre.... 
essay.-Pre 

pre,,. 
. pre_ 



1.08 6.83* 0,30 0.64 0.00 
1.49 3,050.10 1,55 0.08 



1 .92 3.13. 0.08 3.24* 0,22 
0.28 5.37* 0.13 5.67* 0.41 



1.71 3.42* 0.07 3.27* 0.32 
0.26 3.05 0.05 5,55* 0.35 



0.94 0.00 0.62 
1.27 0,04 2.12 



w2 




.2 


(1) (2) 


0.02 


0.88 


0.13 


9.03 9.35 


0 07 


1.13 


0.01 : 58.89 54,42 


0.00 


0.26 


0.00 


5.79 6.00 


0.03 


1.73 


0,05 


5.69 5.13 


0.01 


0.87^ 


0.21, 


7.69, 7.83 


0.00 


0,69 


0.00 


, ,7J0' 6.89 


0.00 


0,74 


0.00 ■ 


8.41' 8.14 


0.04 


0.75 


0.00 


2.59: 3.33 


0.16 


0,53 


0.03 


10.72 10.58 


0.00 


1.58 


0.03 


1.79 1.58 


0.10 


1,43 


0.09' 


8.15: 8.09 


0.18 


0,93 


0.00 


1.56 1.55 



(3) (4) (5) F|,i, F|,i7F|,i7 

9.03 9.35 8.78 9.40^.23 8i -1.62 1.11 3,45 1.73 

58.89 54,42 , 53,81 50.16 57.45 1 4.65 -100,25 1.96 0.04 3.89 



6.16 4.73 6.20 5.61 

5.73 3.89 5.15 4.37 

7.02 i 5.96i 7.83 6,07 -.. 9.59 0.04 

6.40' 5.93! 7.08 5.36 - 8.80 0.03 



6.80 0.30 0.18 14.16* 
5.93 1.71 1.97 18.25* 
1.56. 7.41 
0.60 2.90 



7.47, 
2.92 



.40 



6.55 7.62 6.86 - 8,38 0.40 2.54 15.24 
2.09 2.79 1.75 - 3.83 0.28 0,64 7.35* 



9.09 9.79 8.45 
0.91.1.46 1.26 



11,13 0.06 1.62 6.72* 
.1.66 1.02 0.66 12.78 



8.15 8.09 6.85 6.93- 6.80 5.60 ■ .fi.flOi O.OI , 2,67 . 
1.56 1.55 ■ 1.39 0.97 1.42 1.24 ,:.J.60 0.00 0.60 8,33 



0.12; 
: 44.69. 
, 8.69: 

0,131 
; 0.68^ 



5,12f 0.09 i 7.80* 0.42 
1.05 0.00 
3.17: 0.06 



5.62* 0,43 
3.62j 0.22 
2.05; 0.08 i 30.05*" 0.02 
4,61 0,32 



3.23fO,07' 



1.69i 0.04 
0.76, 0.00 
2.48; 0.13 
5.32r 0.04 
0.60; 0.00 



9.65* 0.12 
4.09 0,06 
2.93* 0,07 
9.80* 0,31 
6.09* 0.10 



1,21; 0.01 
1.84' 0,05 
2,9810.11 
6,99* 0.18 
2.47^ 0.00 



0.52 
12.41 



: 0.52' 0.41 i 0.95: 0.56' '0.48^ .0.64 0.00 

: 10.97. 11 :9T 11. 38 13.33-17.95 - 44.61 2.79 

3.30! 2.96, 3.05 i 2.12; 3.87 -2.21 - 9.95 0.79 

0,]6l 0.57 ; 0,51 0.25' 0.70 :0.61 - 0.79 1.78 

3.04; 3.08' 2.861 2.79' 3.08 : 2.60 - 3.56 0.19 



0.65 14.52* 
1.25 0.27 
0.05 8.54* 
0.16 7,50* 

4.43 4.76*: 



0.06: 3.38' 
0.35: 1.45 



0.16 i 0.47 1 0,10 
0.03' 1.59 i 0.11 



i 0.10; 2.13i 0.07: 1.54! 0,11 



l.lll 0.02! 0.77 j 0,00 i 0.33 0.00 
1,14; 0.03: 0.58:0.02 j 0.40: 0,07 
0.78i 0.00 0.82,0.00 ' 0.77! 0.00 



0.33' 0.10 ! 0.10 
1.36' ' " ' 



I 



0.03' 0,56 iO.52 - 0.60 '5.55* 0.00 . 2,90' 
.82 1 1.64 i 1.431 1,65 :i.41 - .1.90,3.57 0.55 0.71' 
.001 0.96; 1.14,0.95 '0.88 - -1.02 ! 2.37 ;0.11 3.75 i 



*Sign"ificarce at the !o5 level. The ,05 levels for F values with the following degrees of freedom are; 
- Fi.l7=4.45 . F2,i7=3.59 F3,i7=3.20 h,:r-l.n Fs,i7=2.49 



a 2 
r 



5 proportion of total variance explained (omega squared), The missing cell in the latin square design 
was estimated to compute the total sum of squares, 

/* J ''Heans for Art Activity Treatment I differ from the actual means because a missing cell valoe was estimated 
24 in the analysis of variance. 

"^CTCS = Coupreliensive Tests of Basic Skills 
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TABLE 2 

Anfllysis of Variance Suimiary for Attitude 
Scales in Study I 



OEPENDEKT VARIABLE 



ADJUSTING 



Vord Association Scale: 
Balance of Nature 
Ecology 
Uolf 

Air Pollution 
Alligator 
Uater Pollution 



pre _ 

pre L 
pre . 



Gall*Crown Discus. Attitude Scale: 
Att. towardlhought Questions pre_ 
Attitude toward Discussion pre ^ 

Ecology Unit Opinions Scale: 

Attitude toward Peers 
' Attitude toward Teacher 

Attitude toward Curriculum 

Ecology Discussion Attitude Scale: 
Att. toward Thought questions 
Attitude toward Discussion GDAS-.Disc 
pre - 

Written Exercise Attitude Scale: 
Att. towardlhought Questions: 
Attitude toward Hritt. Exer. : ^ 

.Ecology Art Project Scale 
Attitude toward Art projects : ^ 
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F VALUES AND FOR ANALYSIS OF VARIANCE EFFECTS 
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0.09 


0.45 
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0.33 
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1.16 


0,0) 


3.46 


0.16. 


0.00 
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0.08 


6.1§* 
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1.41 
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Art 

Filler] ActivA'rit 
I Exerc. 

(5) 



Ym Limits 
for Treat- 
Dent 5 



PLANNED COHPARISONS 



Treat- 

Qents 
11 vs 2 



Treat- 

mts 
: vs 3 



Treacioenc 
1.2.3 vs 



fi,17 fl,17 



,90 0.09 55.62 57.61 57.66 55.52^ 54.35 39.54-69.16 1.35 0.00 0.91 



4.18 3.42, 
5.92* 7.23 



31.68 
35.82 



61.85 



*Significance at the .05 level. The 05 levels for F values with the following degrees of freedom are: 
F1.17M.45 F2^j7.3.59 F3^^^ = 3.20 F^^^^ = 2.70 F^^^^-z.^ 

'"llclT'^II '^^^ ^^^^'^^^^ ™<"ing cell in the Latin square design 

was estimated to compute ttie total sun of squares. ^ 

'^uf anU^^^^ ' ^""^ "^"^^ ' "'1 ^^1"^ «ti.ated 5 

23 27 



ERIC 



was not replicated in a different experiment using fifth grade students. 
The third methodologically ^l^^<i study found that questions framed by 
teachers are more effective ^^^r\ questions presented in text for second 
graders. 

The results of previoii^ "^©Search on teachers' higher cognitive 
questions are not conclusiV^; The main implications of the review of 
literature is that further "^^se^^ch characterized by rigorous methodology 
is needed. 



Treatments 

The cormon basis for tj! ^^ur experimental treatments was the same 
ecology curriculum used in I. The curriculum included ten lessons, 

each requiring an hour of c"«ss time, and taught at the rate of one per 
day. Following viewing an^'/°'^ ^eading of materials at the start of each 
lesson, students formed int° ^h^ir assigned treatment groups. The four 
treatments are as follows: 

25 % HCQ (Higher Co gnl^l^Questionsj^ Treatment . The same ecology 
teachers who particTp^^^J study I conducted nine "scripted" 
discussions, one for ^f """"^ lessons. Each discussion in 

each treatment consist^° of sixteen questions. In the 25% HCQ 

treatment the discussi°"s consisted of twelve fact questions and 
four higher cognitive.'l^estions. The questions pertained to the 
curriculum content whi^"^ W^s included in the day's lesson. The 
ecoloqy teachers prob^^ ^nd redirected students' answers to most 
of the questions in t^eatment, as in the 50% HCQ and 75% HCQ 
treatments (see below)- 

50% HCQ Treatment . ^'^^'s treatment the discussions consisted 
of eight fact questio^^ and eight higher cognitive questions. 
The eight fact questi^JI ^ere selected from the set of twelve 
fact questions in the HcQ treatment. The four higher cog- 
nitive questions of t^^ 25% HCQ treatment also appeared in the 
50% HCQ treatment, p1^^ additional four higher cognitive 
questions. 

75% HCQ Treatment . ^'^^'s treatment the discussions consisted 
of four fact question^ and twelve higher cognitive questions. 
The four fact questlo^"^ and eight of the twelve higher cognitive 
questions were select^ the 50% hCQ treatment. 

Art Activity Treat mgnS-' The students in this treatment partici- 
patPd in nine sessTorP.°f ecology-related art activities. The 
ecology teachers were ■"^st:y^ucted not to ask any curriculum- 
re'Jated questions. 

The 50% HCQ Treatment was identical in format to Probing and 
Redirection Treatment^ J^n study I. The Art Activity treatment 
was identical in both ^^i^clies. 



28 



xxiv 



If the dependent variable was adjusted before the data were analyzed, 
the name of the adjusting variable appears in the column labled "Adjusting 
Variable." The majority of the adjusting variables are the pretreatment 
measures corresponding to the dependent variable, signified as pre. 
Otherwise total reading score was generally the adjusting variable. 

The column labeled "MS error" presents the error mean square from the 
analysis of variance of cell means or adjusted cell means and its degree 
of freedom for each dependent variable. 

The next five columns list the F-statistics computed for the main 
effect of treatment, of class within squares, of teachers within squares, 
of squares and the treatment by square interaction, respectively. The 
adjacent columns show the strength of association statistics associated 
with each main effect. This statistic is interpreted as the percentage 
of variance in the dependent variable attributable to the treatment 
effeut for that column. 

The next four columns present cell means for each treatment- condition 
in the Latin square design, that is. Probing and Redirection, No Probing 
and Redirection, Filler Activity, and Art Activity, respectively. For 
those variables which were adjusted before entry into the analysis of 
variance, these values are adjusted cell means. 

The unadjusted cell means for the Written Exercise Treatment are 
also listed. The column labeled "95% Limits for Treatment 5" presents 
a "confidence" interval about each written exercise treatment mean. The 
mean square error term from the analysis of variance was used in calculating 
these limits. 

The next three columns present F-statistics for the planned compari- 
sons of treatment group means or adjusted means. The first of these 
columns compares Probing and Redirection with No Probing and Redirection 
(1 vs 2); the second contrasts No Probing and Redirection with Filler 
Activity (2 vs. 3). The next column compares the average effect of the 
three discussion treatments with the non-discussion Art Activity treatment. 

To assure that the results for various post and delay measures were 
not simply reflecting pre-existing differences among the sampled students, 
analyses of variance were performed on the total reading scores, i.e., 
the sum of vocabulary and comprehension subscale scores from the Compre- 
hensive Tests of Basic Skills, and on average number of lessons attended 
by students within a group. No effects significant at the 5 percent level 
were observed, and omega squared values were generally small, ranging 
from .01 to .13 across the analysis of variance effects. 

Differences Between Discussion Treatments. Only one of the planned 
contrasts involving comparisons of the discussion treatment means was 
statistically significant. Because of the large number of comparisons, 
there is a high probability that this difference is a chance finding. 
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Discussion Treatments versus Art Activity . Inspection of Table 1 shows 
that eight of the ten achievement measures yielded statistically signifi- 
cant differences favoring treatment groups exposed to discussion. With 
one exception each of the discussion treatments was also superior to the 
Art Activity mean on the two nonsignificant measures. It appears that 
discussion has a positive effect on learning by promoting acquisition and- 
retention of facts, and by promoting skill in giving higher cognitive . . 
responses (both oral and written) to questions. 

Only one of the attitude scales significantly differentiated the 
discussion treatments and the Art Activity Treatment. This difference, 
and each of the other nonsignificant differences, favored the discussion 
treatments slightly. 

Written Exercises . Using 'the ''test" of significance described above, 
it appears that the Written Exercise Treatment promotes more learning 
relative to the Art Activity Treatment means on a variety of variables 
related to acquisition and retention of information and skill in giving 
higher cognitive responses on oral and paper-and-pencil tests. 

The means for the Probing and Redirection Treatment fell slightly 
above the 95 percent confidence limits for the Written Exercise means on 
several of the higher cognitive measures: the Content scales of the Oral 
and Transfer Tests and the Logical Extension scale of the Essay Test. 
A few other discussion treatment means fell above or below the 95 percent 
limits of the corresponding Written Exercise means, but they do not define 
a meaningful, pattern. None of the discussion treatment means on the 
attitude scales fell outside of the 95 percent limits. 

Other Effects . The analysis of variance confirmed prior expectations 
in revealing significant differences among classrooms on the majority of 
classroom type achievement measures. Also, as expected, the main effects 
attributable to ecology teachers were negligible. This result probably 
reflects the training given to the ecology teachers in following pre- 
scribed instructional patterns for each of the treatments. 
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study II 



Purpose 

Study II was conducted to determine what student learning outcomes 
are affected by variations in teachers' use of higher cognitive questions 
in classroom discussions. The classification of a question as "higher 
cognitive" was based on two criteria derived from Bloom's taxonomy of 
educational objectives in the cognitive domain (Bloom, 1956). First, a 
higher cognitive question requires the student to state predictions, 
solutions, explanations, evidence, generalizations, interpretations, or 
opinions. The second criterion is that the prediction, solution, etc.^ 
asked for in the question is not directly available in the curriculum;^ 
materials; instead, the student is required to expand on or use in a new 
way information presented in the curriculum. j 

The experiment was designed to test the belief of many educators : 
that teacher use of higher cognitive questions is important for develop- 
ing students' ability to think. On this basis it was predicted that ; 
discussions with a high percentage of higher cognitive questions would^ 
promote more learning than discussions with a low percentage of these . 
questions. Another purpose of the experiment was to determine the effects 
of presence versus absence of discussions on student learning. ! 

Review of Literature ; 

The correlational studies relating cognitive levels of teachers' | 
questions to student learning were reviewed by Rosenshine (1971), who ' 
concluded that "no clear relationship has been found between the frequency 
with which the teacher uses certain types of questions and the achievement 
of pupils..." (page 125). Further review and analysis by Heath and t 
Nielsen (1975) indicates that the findings of these and similar studies 
are difficult to interpret because of flaws in research design. One I 
problem is the limited range of student achievement measures which werie 
used. For example, Wright and Nuthall (1970) found that the percentage 
of closed, that is, fact, questions was positively correlated (r=.46) 
with residual student achievement scores, whereas the percentage of open, 
that is, higher cognitive, questions was negatively correlated (r=-.21;) 
with the same criterion. The measure of student achievement was a \ 
multiple-choice fact recall test, which probably is appropriate for 
measuring the effects of fact questions but not of higher cognitive 
questions. This problem is handled within the experiment reported 
here by including tests designed specifically to measure higher cog- ' 
nitive^; learning outcomes. 

Winne (1975) reviewed twelve experimental studies of teacher ques- 
tions and found that "nine of them probably could. not speak validly to 
the degree of imfluence that teacher questions have on student achievement." 
One of the three studies which were methodologically sound found that ; 
higher cognitive questions lead to improved achievement relative to 
lower cognitive questions for second graders. However, this finding 
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As in Study I, audiotapes of the three discussion treatments were made 
for two different lessons. Analysis of the audiotapes indicated high 
fidelity of treatment, that is, close correspondence between the discussion 
scripts and the teachers' actual behavior. Live observations of the Art 
Activity lessons indicated that the ecology teachers adhered closely to 
the requirements of this treatment. 

S tudent Sample 

Study II was conducted in the Novato Unified School District, Novato, 
California. A total of twelve sixth-grade teachers, two in each of six 
schools, volunteered for their students to participate in the study. A 
total of 371 students from these classes served as the sample for the study 

Experimental Design 

The four treatnients—25% HCQ, 505^ HCQ, 75% HCQ, and Art-Activity— 
were manipulated in the same Latin square design used in Study I- Each 
discussion group consisted of six students. Since there were three 
discussion groups in each classroom, a total of eighteen students were 
involved in discussion treatments. The remaining students in the class- 
room were assigned to the Art Activity treatment. 

Measures 

With one exception, the same measures and order of administration 
used in Study I were repeated in the assessment of Study II outcomes. 
In Study II, the Information Test was scored on different scales than 
in Study I, as follows: Intentional Scale II contains eight items 
measuring students' ability to recall information covered in each of 
the discussion treatments. The 25% HCQ Incidental Scale II consists of 
seven items which were intentional only for students in the 25% HCQ 
Treatment; the items were incidental for students in the other treatments. 
Incidental Scale II consists of the items testing recall of information 
presented in the curriculum materials but not in any of the treatment 
variations. 

Pa_ta Analysis Plan 

The plan of data analysis used in Study I was repeated in this 
study, except that different planned comparisons were involved. In 
Study II, the following planned comparisons of treatment differences 
were examined: (a) 25% HCQ versus 50% HCQ; (b) 50% HCQ versus 75% HCQ; 
(c) 25% HCQ versus 75% HCQ; and (d) the discussion treatments as a whole 
versus Art Activity. 

Findings 

The results of the primary data analyses are summarized in Table 3 
(measures of ability, achievement, and attendance) and Table 4 (attitude 
scales). These tables repeat the format used in Tables 1 and 2. 
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TABLE 3 

Analysis of Variance Smvj for Study 11 
Measures of Ability, Achievement, and Attendance 



DEPF.NDENT VARIABLE 



AWOSTING 
VARIABLE 



df=18 



F VALOES AND / fOR ANALYSIS OF VARIANCE EFFECTS TREATHENT HEANS 




PLANNE 


D COMPARISONS ! 

-1 


Treatitient 


Class 


Teacher 


Square 


Treatment Treat- 
by Square ^jjsaL. 


Treat' 
sent 


75XHC0 
Treat- 

nent 


Art 
Actlv. 
II 


Treat- 

lvs2 


Treat- 
nents 
2 vs 3 


Treat- 
tsents 
1 vs 3 


Treatments 
1,2,3 vs 4 



3,18 



f« i« ^2.18 ^18 



9,18 



'2,18 



Ntnber of Sessions Attended 
aes''- Total Reading 



0.51 
48.?5 



(1) (2) (3) (4) fi^iB Fj^ia hM h,li 
0.18, 0.00" 0.46 0.00 0.96, 0.00 1,49 0.02 1.11 0.01 9.23 9.04 9.17 9.21 0.45 0.19 0.06 0.07 
0.53 0,00 1 .30 0.02 0.82:0.00 0.93 0.00 1.01 0.00.61.69 64.71 ^1.85 63.63 1.13 1.10 0.00 0.14 
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Ecology Information Test: 
Intentional Scale II, post 

Intentional Scale II, delay total rdng. ' 0.40 

m Intentional Scale II, post total rdng. 

251 Intentional Scale II, delay total rdng. 

Incidental Scal^ II, post total rdng. , u.w 

Incidental Scale II, delay total rdng. 0.68 



8.55 0.31 
12.51] 0.42 
0.351 9,4610.40 
0.49 5.20*0.25 
0.48' 7.49*0.27 
7.30* 0.28 



08 0.01 



1.42 0.05 

0.77, 0.00 0.92 

1.00: 0.00 0.54 0 

0.75' 0.04 0.42, 

1.60, 0.07 0.88^ 

1.37 0.05 0.49, 



0.72 0.00' 0.69 0.00 

: 3.85* 0.07 , 0.54 0.00 

00 0.48 0.00, 0.28 : 0.00 

0.00 0.54 ^ 0.00 0.73' 0.00 

2.37 0.04 1.57 0.05 

0.00 I 1.86 0.03, 0,90' 0.00 



Oral Test: 
Content, post 
Logical Extension, post 

Essay Test: 
Content, post 
Logical Extension, post 

Transfer Test: 
Content, delay 
Logical Extension, delay 



pre 
pre 



pre 



1.10: 
0.68: 



J, 



5.53*0.19 ' 0.42, 0.00 0.73:0 
4.911 0.13, 3.49* 0.25 1.19 0 



: 6.27! 5.94 6.29' 5.26 > 2.01, 2.21 0.00 22.83 

6.19 i 5.261 5.85; 4.74 113.12 5.31* 1.73.24.10; 

' 4,68' 3.53; 4.01! 3.621 22.96 3.97 7.83,, 5.21 

' 4.5,2' 3.56! ,U6, 3.56 11.59 0.50, 7.30 : 2.67 

[,.97 4.92; 6.83; 5.00 '13.66; 10,29* 0.24 , 6.34 

■ 5.91 i 4.521 5.34i 4,67 i 17.22 i 5.97*2.91 i 4.49 



00 ■ 9.88*' 0.25 2.12 0.15 
02 3.22 0.05 1.42 0.03 



8,?$ 8.83 ('•,42 7.35 0.01 0.96 1.17 15.15, 
4.0,)! 3.80 3,10 2.95 0,50 4.30 7.73 6.39 



Ess. Cont,pre 



Written Question Generating Test: : 
Non-pertinent (juestions 
Pertinent diiestions iP'^s 
Specific Questions 
Request for Rationale 
Quality Rating 

• Oral Question Generating Test: 
Non-pertinent Questions 
Pertinent Questions , 
Quality Rating , 



1.19 


8.15* 


0.14 


0.71, 


1.18 


0.01 


2,29: 


0.32 


0.00 


0.39 


0.64 


0.00 


i 

0.16, 


1.08 


0.00 


3.52 


2.81 


0.04 


1.53 i 


2.66 


0.07 


0.18 1 


0.37 


0.00 


0.061 


0.51 


0.00 


0.031 


1.23 


0,00 


0.45, 


0,61 


0.00 


0.07' 


0,12 


0,00 



.75 0.15 0.34 0.00 
1.33" 0.32 1.2410.03 



1 57 0 01 0,97 0.00 11.58 12.55 11.64 ^0.36 4.73* 4.11 0.02 18.54* 

\m I'm O 0.00 i.!!, 2.301 2.03,, 1.68 1.34 . 0.62 0.04 2.89 

1.78 0.04' 0.58 0.00 8.79 8.99 8.62 8.40 0.10 0.07 0.61 0.51 

1.03; 0.00: 0.38 0.00 1.67 1.73 1.85 1.51 0.07 0.22 0.53 1.37 



1.4K 

7.63* 

3.95r 

0.61 

1.75 



0.07: 
0,43; 
0.36; 
0.13 1 

0.14: 



0.77 
1.33 
0.40 
0.65 



00 • 2.29 ■ 0.05, 0,74 

02 15.10* 0.20 i 0,33 

00 , 0,50, 0.00 1 1.02 

00 ' 0,27 . 0.00 : 0.21 



0,90 i 0.00 0,83 . 0.00 0.36 



1.61: 
0.66, 
1.24 



0,05: 
0.00 1 
0.05: 



0.98! O-OO : 3,86* 
0.981 0.00 : 0.49 I 
0.47^0.00 : 3.35 i 



1.41 
1.22 
0.32 



0.00 0.3/" 0.43' 0.6': 0.34' 0.1111.28 

0.00 1 2.48 1 i3.5l| 12.52 11.29! 1.80 1.68 

0.00 3.24: 4.16 3.12i 2.81 , 3.36 '4.25 

0.00 0 56^ 0.51 0.42: 0.39: 0.08 ' 0,29 



0,00 2.94 I 2.98 



2.B6I 2.94 : 0.21 : 



0.02 
0.03 

o.oe 



0.18! 
1.85 

1.06: 



1.87 
1.10. 



CSV 

1.56 1.64 
1.05, 1,02 



3,49' 1.17 
0.00, 1.25 
0,07:0.19 



2.15 
0.00 
0.05 

D.e'5 

0.57 



0.62 
1.11 
0.03 



6.12 
2.87 
0.42 
0.02 



0.17 
0.27 
0.17 



"Significance at the ,05 level. Tlie .05 levels for F values with the following degrees of freedom are: 

F, .. ' 4.41 F ' = 3.55 F - nc F = 2.66 F = 2.45 
fl..J ^i^jj ^3,16 = 3.16 6,16 9,]e 

'"^ s praportion of total variance explained (omega squared). 
•"CTBS •■ CouprehensiveJest of Basic Skills 
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TABLE ^ 

Analysis of Variance Suwry for Attitude 
Scales in Study n 



DEPENDENT VARIABLE 



ADJUSTING 
VARIABLE 



Uord Association Scale 
Ecology 

Balance of Nature 
Wolf 

Air Pollution 
Alligator 
Uater Pollution 



pre - 



F VALUES AND FOR ANALYSIS OF VARIANCE EFFECTS 



TREATHENT MEANS 



Jreatment 


■ Class 


Teactier 


Square 


Treatment 
by Square 


'3,11 


^,18 


^18 







25«HCQ|50^HCQ75?HM Art Treat' 



Treat- 
ment 



Treat- 
ment 



Activ.uients 



II 



PLANNED COMPARISONS 



Treat- 
ments 



Treat- 
ments 



vs22vs31 vs31,2,3 vs 4 



Treatments 



30 97 0 48 0.00 1 .14 0,03 0.80 0.00 ].]] 0.00 0.79 U-M 62.49 63.01 64.51 61.91 0.05 0.43 0.79 0,59 

]6ll 1*94 0.05 0 96. 0.00 0.79 0.00 0.39 1.00 i.a? 0.09 59.73 59.40 61.41 57.93 0.04 1 .48 1.02 4.12, 

10!l3 6!33* 0.23 0.65 ^-^ 1 .55 0.07 1.64 0.05 57.4B 

6 51 0.48 0.00 0.34 0.00 i 0.59 0.00 1 .02 ■ 0.57 

10.62; 7.40t 0.27' 1.84^ 0.10 i 0.65 0.00' 0.19, • 0.81 

6.76' 0.53^ 0,00 0.72 0.00 0.75 0.00 4.21 0.12, 1.44 



0.00 60.21 
0.00 51.65 



55.74 57.57 i 52,62' 1 .81 1.98, 0.00 16.46" 
59.22 59.59 ■60.27 0.91 0.13, 0.35 0.51, 
49.42 54.61 46.86 2.32 5.74 . 0.51 16.15 



0.05 59.91 .58.59 .59,07 59.15 1.55 : 0,21 0.52 0.00 



Gall-Crown Ois. Attitude Scale; 
Att. toward Thought questions; pre 
Attitude toward Discussion 

Ecology Unit Opinions Scale: 
Attitude toward Peers 
Attitude toward Teacher 
Attitude toward Curriculum 

Ecology Discussion Attitude Scale; 
Att. toward Thought (Juestions 
Attitude toward Discussion GDAS,. 

pre .'. disc 

Ecology Art Project Scale: 
Attitude toward Art Projects , _ 



'4 54 1 38 ' 0.02 0.54 0.00 0.95 0.00 ; 1.26 ; O.Ol 2.24 J.14 30.33 :29.91 ,30,83 29.13 J.23 1.13 0.34 3.00 
pre! 22!44: iil 0.00 1.23: 0.0410.45 : 0.00 1 1.29' 0.01 1.73; 0.09 56.14 ,55.69 j54.17 53.92, 0.05 : 0.62 1.04, 0.80. 



69^ 2,55' 0.08 1,04: 0.00 0.64 J.OO 0.37, 0.00 1 .63 0.07 16.87 



o'21 0!00 0.00 1 .46 ' 0.08 1.24 0.01 1.07 
5.77 0,29' 0.00; 0.53' 0.00' 1.35 ■ 0.06 3.49 "-lO 0.43 0-00 32.30 



17.12 17.06 '15.83 0.21 0.01 0.12. 7.44' 
'58.09 57.70157.16:0.00 0,08 0.08 0,53 
32.03 ^31.49 31.61 0.07 0,30 0.67 0.17 



14.74 0.04' 0.00; 0,78: 0.00 
19.71 0.11 0.00 0.64 0.00 



0 64 0.00 0 67. 0.00 0.15' 0-00;33.26 132.88 32.92 
l.'lS ■ 0.02 iif 0.28 0.48 ' 0.00 59.67 '59.39 60.23 



0.06 0.02 0.07 
0.02 0.13 0.00 




♦Significance at the .05 level. The .05 levels for F values with the following degrees of freedom are: 
F,^13 = 4.41 Fj^^^=3,55 F3,:3 = 3.l6 F6,)t=2,66 Fg^jj =2.45 

= proportion of total variance explained (omega squared). 
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To assure that the results for various post and delay measures were not 
simply reflecting pre-existing differences among the sampled students, 
analyses of variance were performed on the total reading scores, i.e., the 
sum of vocabulary and comprehension subscale scores from the Comprehensive 
Tests of Basic Skills, and on average number of lessons attended by students 
within a group. No effects significant at the 5 percent level were observed; 
the omega squared values were zero, with one exception. Similar results 
were obtained for number of sessions held. 

Differences Between Discussion Treatments . The planned comparison of 
the discussion treatment means shows that percentage of higher cognitive 
questions was a statistically significant influence on the amount of infor- 
mation acquired by students as measured by subscales on the Ecology Infor- 
mation Test. The pattern of treatment mean scores is depicted in Figure 1. 
It appears that a U curve describes the relation between percentage of 
higher cognitive questions and achievement on intentional and incidental 
scales of the Ecology Information Test. In all cases, the 50% HCQ treat- 
ment has considerably lower outcomes on the subscales of the Ecology 
Information Test than the other two discussion treatments. The 75% HCQ 
and 25% HCQ treatment outcomes fall at similar points for the various sub- 
tests. Outcomes for the art activity treatment approximate those for the 
50% HCQ treatment. 

The 25% HCQ treatment was superior tc the other two discussion treat- 
ments on the 25% HCQ Intentional Scale II. This finding is predictable, 
in that students in the 25% HCQ treatment had the advantage of answering 
(intentional) items which were not covered in the discussions qf students 
in the 50% HCQ and 75% HCQ treatments. 

Two of the comparisons involving higher cognitive achievement measures 
were statistically significant. Students in the 50% HCQ treatment out- 
performed students in the 75% HCQ treatment on one of the Oral Test 
measures. They also outperformed students in the 25% HCQ treatment 
(statistically significant) and in the- 75% HCQ treatment (approaching 
statistical significance) on one of the Sssay Test measures. 

The mean scores of the discussion treatments on the attitude scales 
were quite similar. Only one of the planned comparisons was statistically 
significant. 

Discussion Treatment versus Art Activity. With one exception the • 
mean scores of students in the combined discussion treatments were 
statistically greater than the mean scores of students in the Art 
Activity treatment on the Information Test measures. Also, the mean 
scores of students in the combined discussion treatments were statistically 
greater than the mean scores of students in the Art Activity treatments 
on three of the six higher cognitive achievement measures. The mean 
score of students in each discussion treatment was greater than the 
corresponding Art Activity treatment mean score for the three measures 
which did not reveal a statistically significant difference. 
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LEGEND 

Intentional Scale II (post) 
Intentional Scale II (delay) 
25% Intentional Scale II (post) 
25% Intentional Scale II (delay) 
Incidental Scale (post) 
Incidental Scale (delay) 




25% Higher 

Cognitive 

Questions 



50% Higher 

Cognitive 

Questions 



^75% Higher 
Cognitive 
Questions 



Art Activit 
II 
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*Data points on the graph are based on unadjusted treatment means. The 
three recitation treatment means are expressed on the ordinate as absolute 
deviations from the art activity treatment means. The latter means serve 
as a baseline or zero value. 
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Planned comparisons involving the attitude measures revealed two 
significant differences. Students in the discussion treatments developed 
significantly more positive attitudes toward animals (wolves and alligators) 
presented in the curriculum than did students in the Art Activity treat- 
ment. Differences in scores on the other attitude scales, although not 
statistically significant, also generally favored the discussion treat- 
ments over the Art Activity treatment. 

Other Effects . Very few of the other effects in the analysis of 
variance— class, teacher, square, and treatment by square—were .statisti- 
cally significant. Omega squared values were consistently small. As 
intended, the main effects attributable to ecology teachers were 
negligible. This result probably reflects the training given to the 
ecology teachers in following prescribed instructional patterns for each 
of the treatments. 



Interpretation of Findings 



The overriding finding of both studies was that discussion following 
critical viewing and/or reading of curriculum materials was substantially 
more effective than a no-discussion art activity in promoting student 
achievement. The achievement variables relate to acquisition and retention 
of intentional and incidental information, the ability to respond in oral 
and written form to curriculum-relevant higher cognitive questions, and 
ability to extend higher cognitive thinking into related content areas. 
There is some evidence, although not nearly as convincing as for the 
achievement variables, that discussion also is more effective in promoting 
positive attitudes toward the curriculum. 

Additional insight into the effects of discussion can be gained by • 
comparing the discussion treatments and the Written Exercise Treatment 
in Study I. Writing responses to questions appeared to develop knowledge 
acquisition as effectively as participation in a discussion of the same 
questions. However, written exercises seem less effective for improving 
higher cognitive response ability than oral discussions in which students* 
responses are probed and redirected. Presence-absence of probing and 
redirection in Study I did not have an effect on student learning. It 
appears that using probing and redirection to help students develop 
exemplary answers to questions is as effective as having the teachers 
directly provide an exemplary answer when students did not give them. , 
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Variation in the percentage of higher cognitive questions in discussions 
does affect learning. However, the effects are puzzling. Relative to the 
25% HCQ and 75% HCQ treatments, the 50% HCQ treatment was the least effect- 
ive in promoting knowledge acquisition and retention, but it was the most 
effective in promoting higher cognitive performance. Since the discussions 
of the 50% HCQ treatment did not emphasize either fact or higher cognitive 
questions, it is possible that students were confused concerning the 
objective of the discussions—was the objective to rehearse facts, or 
to think about them? To lessen their sense of confusion, some students 
may have decided to concentrate on answering teacher higher cognitive 
questions and ignored the fact questions, thereby causing a decrement in 
performance on the Information Test. 

As expected, students in the 25% HCQ treatment answered correctly 
more of the Information Test items which were intentional for them, but 
incidental for students in the other two treatments. This finding 
suggests the generalization that if the teacher wants students to learn 
certain information in the curriculum, it is effective to rehearse that 
information by asking questions in discussion. 

In summary, the findings of the two studies demonstrate convincingly 
^ that an instructional pattern of reading curriculum material followed by 

small-group, semi -programmed (that is, '"scripted") discussion is effective 
in promoting student learning. Variation in use of questioning techniques 
within this pattern appears to have less significance for promoting student 
learning. Further research is needed to determine whether the discussion 
method remains as effective when it is less structured and when it is 
conducted with larger groups of students. The methodology used in the 
two studies may be useful in investigating these, and related, Il'esearch 
issues because it permits experimentation w/lth frigh internal validity to 
be conducted in school settings. 
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INTRODUCTION 
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CHAPTER ONE 
PURPOSE 



The Effective Teacher Education Program (ETEP) is a program of research 
and development in teaching that, to date, has had three major purposes: 

- To develop teacher training materials that incorporate the micro- 
teaching approach to training and that develop teachers' use of 
specified teaching skills (the Mini courses); 

- To study the effects -upon student outcomes of specific teaching skills 
(for the most part these have been skills that were contained in one 
or more of the Mini courses); 

- To test various approaches to the study of teaching. 

The current programmatic effort is devoted entirely to the latter two 
objectives. Some two and a half years of research have been assigned to 
this effort. All research and development work to date has been sponsored 
by the U. S. Office of Education and the National Institute of Education. 

The current program grew out of the Laboratory's earlier work in the 
field of teacher education. In 1966, the Laboratory's Teacher Education 
Program received federal funding to develop a series of skill-training 
packages for teachers called Minicourses (Borg, Kelley, Langer, and Gall, 
1970). As a result of the development and testing of these courses, research 
evidence has been accumulated which shows that they are effective in bring- 
ing about desirable changes in teachers' classroom behavior. A small 
number of research studies (Hofmeister and Stowitschek, 1974; Strickler, 
1972; and Ward, 1971) also have examined how the changes in teacher behavior 
brought about by Mini course training subsequently affect student learning. 
Yet, we know relatively little about whether students of Mini course- 
trained teachers learn more than students of untrained teachers. 



In response to this issue, the Effective Teacher Education Program 
has undertaken an ambitious multi-year prOyram of research on teacher 
effectiveness . 

The research topics selected for study by ETEP were a direct out- 
growth of the competency-based teacher education movement. Teaching 
skills considered important by theorists, researchers, and trainers 
(e.g., Dodl, 1972; Turner, et al., 1973) were included in the Minicourses 
that were developed during the initial seven years of work. These skills, 
in turn, became the focus of the current ETEP research. .The three 
aspects of teaching that have been investigated include: 

- Use of questioning skills . The two questioning studies reported 
herein represent the research in this area. The teaching skills 

of interest were taken from Mini course 1, Effective Questioning - 

Elementary Level , and Minicourse 9, Higher Cognitive Questioning . 
As will be discussed in greater detail in this report, the purpose 
of Study I was to study the effects on student achievement and 
attitudes of teacher use of probing and redirection during a 
discussion. The purpose of Study II was to investigate the effects 
of teacher use during discussions of differing proportions of 
higher cognitive questions (25%, 50%, 75%) in relation to fact- 
recall questions on student achievement and attitude. 

- Use of mathematics tutoring skills . Three studies were conducted, 
each employing a different individual in the tutorial role (regular 
classroom teacher, paraprofessional , junior high school student). 
The tutoring skills to be studied were taken from Minicourse 5, 
Individualizing Instruction in Mathematics . 

- Use of an independent learning system . The purpose of this study 
was to investigate the effect upon students of an instructional 
system. Training in the implementation and use of the independent 
learning system was provided by Minicourse 15: Organizing Independent 
Learning— Intermediate Level . 

In addition to studying the effects on students of teacher use of the 
above sets of skills, the ETEP research has explored four approaches to the 
study of teaching. The approaches fall along a continuum of research 
techniques that range from a tightly controlled laboratory experiment to 
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wo»k in the regular classroom where instructional and other variables 
are allowed to vary naturally (S'=i<; Figjre 1). 



FIGURE 1 

Continuum of Approaches to the Study of Teaching 

Laboratory^ 1 2 3 ^->??9ular 

Experiment^ 1 ^ ^ T^Classroom 

1 - -Semi -programmed approach 

2- -Experimental Teaching Unit ... ^ . ^ ^- i 4.4. • „ 

3- Train teacher; study specific skills in specified instructional setting 
.4— Train teacher; establish instructional system; study overall effect. 

The semi -programmed approach, was used in the questioning studies. 
In this approach, the teacher is provided a set of curricular materials 
to use with the students. The sequence in which the materials are to be 
used is specified and the teacher is directed to conduct a discussion and/or 
some other activity as part of each day's lesson. When a discussion is 
specified, the teacher is provided a script which tells her/him the 
questions to ask and in what sequence. The script is only "semi" programmed 
because some teacher behaviors during a discussion are contingent upon 
student responses. For example, in the questioning studies, the script 
could dictate the questions to be asked and approximately how many times 
probing was to occur but it could not prescribe which student responses 
would be probed. , 
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The Experimental Teaching Unit (ETU) approach was incorporated as 
a sub-study of the mathematics tutoring study with teachers as tutors. 
An ETU consists of a statement of teaching and learning objectives, 
currlcular materials for students, and criterion-referenced pre and post 
tests. Teachers are allowed to organize and teach the unit as they wish. 
This approach, therefore, controls the content but not the process of 
instruction. 

The third approach, training teachers to use a particular set of 
skills, then studying the effects of their application in a content area 
and/or instructional setting that is ongoing in the classroom, is a familiar 
form of research on teaching, it has been used in a large number of the 
existing studies of teachers. It was employed in the ETEP math tutoring 
studies. 

The fourth approach parallels the research procedures applied to 
many previous studies of innovative educational programs. Teachers 
are trained in a new educational program; the program is put into 
operation; the effects on students are studied. This approach was used 
in the ETEP Independent Learning Study. 

A report of findings follows for the two questioning studies con- 
ducted as part of the ETEP research. The purpose of this research was to 
investigate the effects of teacher use of discussion skills on student out- 
comes. More specifically, the research objectives examined in Study I were: 

- To determine what student learning outcomes are affected by presence 
or absence of probing and redirection in discussions; 

- To determine what student learning outcomes are affected by presence 
or absence of discussions; 

- To determine the relative effect on student learning of teachers 
questions delivered in discussions compared with the same questions 
presented and answered in written format. 



The objectives of Study II were: 

- To determine what student learning outcomes are affected by variations 
in the percentage of higher cognitive questions in discussions; 

- To determine what student learning outcomes are affected by presence 
or absence of discussions- 

Both studies provided a test of the strengths and weaknesses of the 
semi -programmed approach to research on teaching. 
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CHAPTER TWO 
BACKGROUND 

The four volumes of this report describe two large-scale experiments 
that examined the effects of variations in teachers' questioning tech- 
niques on student achievement and attitudes. This volume presents the 
purpose, method, results and discussion of the experiments. Volume II 
includes the curriculum and treatment materials which were used. Volume 
III includes a copy of each student achievement and attitude measure, and 
its scoring key or scoring manual. In the final volume item statistics 
for the objective measures are presented. 

STRATEGY FOR STUDYING THE EFFECTS OF TEACHING SKILLS 

Planning for the Questioning Studies involved consideration and 
ultimate rejection of two major approaches for investigating teacher 
effects on student achievement. The first approach that was rejected was 
use of a Minicourse to train a group of teachers followed by confirmation 
that the desired behavior changes had occurred and observation to deter- 
mine whether students of these teachers achieved at a higher level than 
students whose teachers did not receive Minicourse training (the approach 
used in the Tutoring Studies). In such an experimental design the indepen- 
dent variable would be the Minicourse and/or the skills used by the teacher 
as a result of Minicourse training. The second approach that was dis- 
carded was creation of experimental treatments in which teachers would be 
trained to exhibit different levels of specific teaching skills. These 
trained teachers then would teach under controlled conditions and their 
effect on student learning would be de^termined. 
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Both these approaches to research on teacher effects had advantages. 
The Minicourse validation approach has the character of "applied" research 
Its findings provide immediate evidence of the effectiveness of Minicourses 
which can be used by teacher educators in decision-making about their 
training programs. In contrast, the skill validation approach has the 
character of "basic" research. It lends itself better to laboratory-like 
control of the independent variables- Ths findings have less immediate 
implications for teacher training. 

The research studies reported here build upon the second approach in 
that they utilize experimental treatments which .incorporate specified 
levels of teaching skill use. However, two important modifications were 
added in these studies. .Special teachers were hired and trained to conduct 
the specified discussions rather than training regular classroom teachers 
and semi -programmed discussion materials were provided to guide the 
discussions. The current research, therefore, approximates a laboratory- 
type experiment even more closely than special training of regular classroom 
teachers. 

TEACHING SKILLS INCLUDED IN THE RESEARCH 

As noted earlier. Questioning Studies I and II focus upon teaching 
skills included in Minicourse 1, Effective Questioning 
Elementary Level (Borg, Kelley and Langer, 1970) and Minicourse 9, Higher 
Cognitive Questioning (Gall, Dunning, and Weathersby, 1971). The skills 
and course objectives are presented in Appendiy A. 



EKLC 



49 



Three basic questioning skills are taught in the Minicourses. The 
first skin is using higher cognitive questions ^ These are questions 
which require the student to respond with an inference, evidence, generali- 
zation, explanation, solution, prediction, or opinion which cannot be 
obtained directly from the curriculum materials. Higher cognitive questions 
generally do not have a single correct answer; several answers usually are 
plausible and defensible. In contrast, a fact question requires the student 
to state a fact—a person, place, date, object, term, definition, etc., 
generally explicitly stated in the curriculum material. Fact questions 
usually have a single correct answer. A variant of the fact question is 
the multiple-fact question in which two or more facts comprise a correct 
answer to the question (e.g., "What does a wolf look like?"). 

The second questioning skill, redirection , occurs when the teacher 
calls on more than one student to respond to a question already asked of 
another student. The third technique, probing , occurs when the teacher 
seeks to improve the quality of a student's initial answer to a question 
by asking a follow-up, that is, a "probing" question. 

Review of Literature (Higher Cognitive and Fact Questions) 

A group of 13 correlational studies reviewed by Rosenshine (1971) 
comprise the bulk of research on levels of questioning, in most of these 
studies operational ization of question levels was insufficiently described 
to permit replication in the current research. For example, in the study 
by Connors and Eisenberg (1966), the teacher variable reviewed by Rosenshine 
was activities focusing on intellectual growth, such as "language, concept, 
or symbolic training; factual knowledge about the world; development of 
sensory abilities, etc." In the study by Furst (1967), lines of transcripts 
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of teacher-student classroom interaction were categorized as analytic, 
evaluative, or empirical (fact stating or explaining). These variables 
included both teacher talk and student taU so that the relationship 
between cognitive level of teacher talk or cognitive level of teacher 
questions to student achievement cannot be isolated. 

Several studies reported factor loadings of a teacher questioning 
variable from a factor analysis of many teacher variables (Perkins, 1965; 
Soar, 1966; Spaulding, 1965; Solomon, Bezdek, and Rosenberg, 1963). It 
appears that the factors, rather than the questioning variable, were 
correlated with student achievement. These correlations are difficult 
to interpret because, as Heath and Nielsen (1973) point out, "A signifi- 
cant correlation between a factor and student achievement. . .does not 
necessarily imply significant correlations between achievement and every 
teacher-behavior item loading on that factor, (p. 13)." 

Wright and Nuthall (1970) found that the percentage of closed, i.e., 
fact recall, questions was positively correlated (r=.46) with residual 
student achievement scores, whereas the percentage of open, i.e., higher 
cognitive, questions was negatively correlated (r=.21).with the same 
criterion. The measure of student achievement was a multiple-choice fact 
recall test, which probably is appropriate for measuring the effects of 
fact questions but not of higher cognitive questions. As Wright and Nuthall 
note, "While [open questions] did not show a positive relationship with 
achievement, they may well have been positively related to other long- 
term cognitive objectives, (p. 490)." The results of this study suggest 
however, that fact questions in discussions are useful for improving 
students' ability to recall these facts in subsequent testing. 
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We have identified four experimental studies in which the cognitive , 
level of teachers' questions has been related to student achievement 
(Buggey, 1971; Savage, 1971; Tyler, 1971; and Ryan, 1973). 

The studies by Buggey, Tyler, and Savage were doctoral dissertations 
at the University of Washington and applied similar methodologies. Buggey 
studied the relationship between teachers' use of fact versus higher 
cognitive questions and the social studies achievement of second-grade 
children. One hundred eight . second-grade children were randomly assigned 
to three treatment groups for six weeks of instruction. One treatment 
consisted of scripted lessons in which there were 70 percent fact questions 
and 30 percent higher cognitive questions- A second treatment consisted 
of lessons with the reverse proportions of higher-order and fact questions. 
A third treatment received no special instruction. Posttests consisted of 
two multiple-choice tests, each of which contained five questions from each 
of the six levels in Bloom's taxonomy of cognitive objectives. The post- 
test mean scores for treatment groups were all significantly different from 
each other. The treatment using 70% higher cognitive questions promoted a 
significantly greater amount of learning than the treatment using only 30% 
higher cognitive questions, while both treatments were statistically 
different from the control group. 

Savage attempted to replicate these findings at the fifth-grade level, , 
but was unsuccessful. One group received instruction consisting predominantly 
of fact questions, another group received predominantly higher cognitive 
questions, and a control group received no special instruction. A signifi- 
cant difference was found between the control group and the two treatment 
groups but the two treatment groups did not differ significantly. 
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Tyler's study was similar to Buggey's except that one treatment con- 
sisted of a scripted lesson in which the teacher orally asked 70 percent 
higher cognitive questions and 30 percent fact questions, while students 
read the questions for themselves in the second treatment. Students in a 
third group received no special instruction. The posttest means were all 
significantly different from each other, with the oral higher cognitive 
treatment group scoring higher than the written group, which was greater 
than the control group. 

Two problems in the studies by Tyler, Buggey, and Savage were that 
teachers were not monitored to determine their fidelity to the scripted 
lessons, and the possibility of differential performance on fact and higher 
cognitive posttests was not considered. 

In the study by Ryan (1973), fifth and sixth grade students were 
randomly assigned to three groups for nine daily lessons. The treatments 
were 75 percent higher cognitive questions, 5 percent higher cognitive 
questions, or no special instruction. A different teacher taught each 
group. Multiple choice posttests of fact-recall and higher cognitive 
achievement were administered following the treatment and again two weeks 
later. On all measures (immediate fact-recall; immediate higher cognitive; 
retention fact-recall; retention higher cognitive), the higher cognitive 
group did slightly, but not statistically significantly better than the 
fact group; both groups performed at a much higher level than the control 
group. However, these latter differences probably Yesul ted from the fact 
that the control group studied different curriculum material than the 
experimental groups. Also, since a different teacher taught each group, the 
findings could have been due to a teacher effect rather than a treatment effe 
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An additional inadequacy of Ryan's study and the studies by Buggey, 
Tyler, and Savage was that the posttests did not measure students' oral 
responses to higher cognitive questions. 

Rosenshine (1970) has reviewed six other experimental studies which 
deal with the relationship between level of teacher questions and student 
achievement. However, according to Rosenshine there are research design 
difficulties in all the studies which limit their usefulness for drawing 
meaningful and valid conclusions about the effectiveness of teacher use of 
fact versus higher cognitive questions for promoting students* learning. 

The current research attempts to reduce the weaknesses identified in 
the previous research on higher cognitive questioning particularly those 
related to: 

- fidelity of treatment; 

- conceptualization and measurement of student outcomes; 

- opportunity for students to learn the content of the posttest; 

- random assignment of students; 

- requirements of the statistical procedures used. 

Liter ature Review (Probing and Redirection) 

Rosenshine (1971, pp. 134-136) was able to identify only three studies, 
all correlational, in which teachers' use of probing or redirection following 
a student's initial answer to a question was related to student achievement 
measures. Two of these studies are not reviewed here because the investi- 
gators did not correlate teacher behaviors with student achievement; instead, 
the factors on which the teacher behaviors loaded were correlated with 
student achievement. As mentioned previously, this procedure probably leads 
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to erroneous inferences about the effects of the teachers' behavior on 
student learning. 

In the^t^iird study (Wright and Nuthall , 1970), teacher redirection had 
a high positive correlation (r=.54) with student achievement scores. How- 
ever, asking a follow-up question at the same or higher cognitive level 
as the initial question was only slightly correlated with student achievement 
(r=.20). As noted previously, a major problem with this study was that the 
posttest consisted of fact-recall items only. Also, the investigators 
did not distinguish between probing and redirection in response to fact 
versus higher cognitive questions during the treatment lessons. 

Because of problems with use of factors rather than specific teacher 
behaviors and limitations in posttest measures, it is reasonable to conclude 
that previous research generally does not yield interpretable findings 
concerning the (effectiveness of teacher probing and redirection. There- 
fore, the presemt studies give special consideration to these problems 
as \Nell as to thie problems of random assignment of students and opportunity 
to learn. 

OVERVIEW OF QUESTIONING STUDIES 

Two studies of teacher use of questioning skills are presented in 
Chapters Three and Four (Study I), and Five and Six (Study II) of this 
report. 

Study I, The Effects of Teacher Use of Probing and Redirection on 
Student Achievement and Attitudes , was designed to determine which student 
learning outcomes were affected by presence or absence of probing and 
redirection in discussions and presence or absence- of discussions themselves. 



It also investigated the relative effect on student learning of teachers' 
questions delivered in discussions compared with the same questions pre- 
sented and answered in written format. 

Study II, The Effects of Teacher Use of Higher Cognitive Questions 
on Student Achievement and Attitudes , was designed to determine which student 
learning outcomes were affected by variations in percentage of higher 
cognitive questions in discussions and presence or absence of discussions. 

As noted above, both studies were designed to reduce or eliminate 
several previously identified research problems. These included the need 
for random assignment of students to treatment, matching outcome measures 
with the intended instructional purpose(s) of the treatment conditions, 
controlling for opportunity to learn, control and monitoring of treatment 
conditions to be sure they were maintained, and investigation of the critical 
assumptions underlying the statistical procedures used in analyses of data. 
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SECTION. II 
STUDY I 

The Effects of Teacher Use of 
Probing and Redirection 
on Student Achievement and Attitudes 



Study I, The Effects of Teacher Use of Probing and Redirection on 
Student Achievement and Attitudes , is discussed in two chapters- First, 
the methodology of the experiment is described. Second, the results 
of the experiment are presented.- A discussion of the results of both 
Study I and Study II is presented in Section IV of this volume. Tech- 
nical issues are discussed in the appendices. 
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CHAPTER THREE 
METHODOLOGY OF STUDY I 

The discussion of methodology covers six main topics: treatments, 
curriculum, participants including both teachers and students, instru- 
mentation, research design, and statistical analysis procedures. 

Since both Study I and Study II > A Study of the Effects of Teacher 
Use of Higher Cognitive Questions on Student Achievement and Attitudes , 
were planned to explore similar problems related to classroom discussion, 
methodological strategies were devised with both studies in mind. Con- 
sequently, the discussion of methodology for Study I will occasionally 
refer to Study II. However, once the main procedures were adopted, both 
studies proceeded as independent experiments. 

TREATMENTS 

The discussion of treatments includes two sub-topics. The first is 
a description of the treatments and the procedures related to their 
implementation. The second is a discussion of the fidelity of treatment. 
Fidelity of treatment provides information on the disparity between the 
intended treatment and the actual treatment as implemented by the partici- 
pants. The more closely the actual treatment corresponds to the intended 
treatment, the greater the treatment fidelity is said to be- Fidelity 
of treatment is an important aspect of this kind of experiment because 
results can easily be contaminated by uneven or idiosyncratic imple- 
mentation of the intended treatment. 
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Description of Treatments 

Study I included five treatment conditions— three discussion treat- 
..ments, an art activity treatment, and a written exercise treatment. All 
treatments were administered to students randomly formed into treatment 
groups from sixth-grade classrooms in a local school district. All treat- 
ment groups used a specially prepared curriculum on ecology. The treatments 
were administered by specially-trained teachers (referred to in this report 
as "ecology teachers"), not by the students' regular teachers. Each 
ecology teacher taught four different treatment groups each day. The 
curriculum, student sample, and teachers are described in the next section 
of this chapter. A discussion follows of each of the treatment conditions. 

Di scussion Treatments . As noted above, the three discussion treatments 
in Study I all used the ecology curriculum. This curriculum consisted of 
one warm-up lesson and nine regular lessons, one lesson a day was conducted 
during a fifty-minute session, C;vor a two-and-one-half week period. Within 
each fifty-minute session, presentation of curriculum materials typically 
consumed 15 to 20 minutes. The .lext 20 to 30 minutes were used for the 
various types of discuss'ions. Each discussion, regardless of treatment 
condition, consisted of 16 questiovis. The decision to use 16 questions 
was based upon pilot work, which indicated i:hat teachers in the sixth grade 
typically could ask 15 to 20 substantive questions in a 20-to 30--mi iute 
period without a time difficulty for aither the teacher or the students. 

In Study I 'thp same 16 questions were asksd in all discussion 
treatment cond^. cTons. These 16 questions contained four fact, four multi- 
fdct, and eight higher cognitive questions. The U it and multi-fact 
questions corresponded to Bloom's knowledge levels. The higher cognitive 
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questions were based on the processes described for the upper levels 
of Bloom's cognitive taxonomy. 

Two criteria were used to generate the fact and multi-fact questions. 
First, each question required the statement of a fact (or facts). Second, 
the fact required was explicitly stated in the curriculum material 
for the same day*s lesson in which the question was asked. No questions 
were repeated in different lessons. 

The higher cognitive questions also were constructed according to 
two criteria. First, each higher cognitive question required predictions, 
solutions, explanations, evidence, generalizations, interpretations, or 
opinions. Second, these predictions, solutions, etc. were not directly 
stated in the curriculum material but required the student to expand 
on or use the information presented in the day's lesson in a new way. 
The classification system* used for the higher cognitive questions was 
as follows: 

- Analysis questions, those which elicit: 

• motives or causes of observed events; 

• inferences, interpretations, or generalizations; 

• evidence to support inferences, interpretations, generalizations. 

- Synthesis Questions, those which elicit: 

• predictions; 

• solutions to problems; 

• original communications. 

- Evaluation Questions, those which elicit: 

• opinions about issues; 

• judgments about the validity of ideas; 

• judgements about the merit of problem solutions. 

The discussions were developed so that the relative proportions of 
each type of higher cognitive question in a lesson were balanced. Thus, 

* This classification system is the same as that which appears in Minicourse 9. 
See Appendix A for description of Minicourse 9 content. 
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"analysis," "synthesis," and "evaluation" questions were approximately 
equally represented. To insure that questions were relevant to the 
curriculum, the curriculum objectives (see Table 4) were used as a basis 
for constructing the questions. 

Building around these criteria 16 questions were generated. The three 
discussion treatments that were developed from these questions included: 

- Probing and redirection treatment . This treatment called for each 

of the four multi-fact and the eight higher cognitive questions to be 
probed and redirected twice.. On the basis of pilot work,* these 
discussions Were expected to take approximately 23 minutes. 

No probing and redirection treatment . The teachers asked the same 
16 discussion questions as in the above treatment. No questions 
were probed or redirected. These discussions were expected to require 
approximately 13 minutes based upon pilot work. 

- Filler activity treatment s This treatment included the same 16 ques- 
tions as the above two treatments. It provided a controlled comparison 
for the difference in time on task between the probing and redirection 
and no probing and redirection treatments. The treatment was identical 
to the no probing and redirection treatment but added a filler activity 
approximately 10 minutes in length to each discussion. The filler 
activities included the following: 

Lesson 1. The students each made a list of things that could 
be done to improve their own environment either at home or at 
school . 

Lesson 2. Students completed a crossword puzzle based on the 
theme of DDT taken from the lesson which had just been read. 

Lesson 3. The students wrote environmental cinquains. This 
was a poetry lesson in which they described elements in their 
immediate vicinity which either pleased or displeased them. 

Lesson 4. Each student designed a patch, first on paper, and 
later on material, to be sewn on an old garment.. The ecology 
symbol and various animals were the most common designs. 

Lesson 5. This was a crossword puzzle about alligators. 

Lesson 6. The students cut out patches and sewed them on old 
clothing. 



* The discussion treatments were pilot tested as part of the initial 
try-out of the ecology curriculum. See pages 35 to 37 for a descrip- 
tion of the pilot test. 
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Lesson 7 The students made collages using primarily photogr-aphs 
from old'magazines. A popular theme was the polluted environment. 

Lesson 8. The students listened to Marvin Gaye's "Mercy, Mercy, 
Me... the Ecology," a popular song, and then read and discussed 
the relevant lyrics. 

Lesson 9. The culminating activity was for each student to 
write a letter to a politician urging action to preserve our 
natural resources. 

The decision to use these particular filler activities was arbitrary in 
that time on task can be operational ized in different ways. They represent 
one.method of keeping students "on task," that is, engaged in an activity 
which is intended to foster learning and which is directed to the curriculum 
content. It is possible that other filler activities that could be designed 
to control for time on task might produce learning outcomes. different than 
those observed in this study. 

An important feature of the discussion treatments was the use of a 
"semi -programmed" discussion technique. In the semi -programmed discussion, 
the teacher follows a script which tells him the questions to ask and 
in what sequence. The script is only "semi" programmed because some 
teacher behaviors are contingent upon student responses. For example, 
in the probing and redirection treatment, the teacher could not probe a 
student's response to elicit a rationale if the student was unable to 
express any response to the initial question (e.g., an "I don't know" 
response). Thus, the script could dictate the question to be asked and 
approximately how many times probing was to occur but it could not pre- 
scribe which student response would be probed. 

To insure that students in all discussion treatments were exposed 
to the same amount of correct information, a set of exemplary responses 
was provided for each question. In cases where no student gave an 
acceptable answer to a question, the teacher provided one from this set. 
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The reason for using the semi -programmed discussion format was to 
control, as much as possible, the conteint and form of the treatment 
received by the students. As noted in the review of the literature, ope 
flaw in past research has been possible variability and imprecision in 
definition of the discussion strategy used by teachers. The semi- 
programmed discussion in large part overcomes this problem. It also 
simplifies the task of constructing posttests which accurately reflect 
students' opportunity to learn a given body of curriculum material. 
The use of semi -programmed discussionsHn this type of research is not 
novel; precedents can be found in the research of Buggey (1971), Tyler 
(1971). Savage (1971), Ryan (1973), and Hunt, Joyce, Greenwood, Noy, 
Reid, and Neil (1974). 

Art Activity Treatment . The students in this treatment participated 
in nine sessions of ecology-related activities. During these sessions, 
the ecology teachers were instructed not to ask questions of any type. 
The time for each art activity lesson was approximately equal to that of 
the probing and redirection treatment (23 minutes). 

The sequencing and types of art activities were allowed to vary at 
the discretion of the ecology teachers. Each teacher was given a packet 
of art activity suggestions. A particular activity could last for one 
period or could be continued over successive days. A brief description 
of some of the activities follows: 

Ecology postcards. The students designed postcards to send to 
penpals or friends. There was an ecology caption on one side, 
a drawing on the other. 

Imaginary animals. The students were instructed to draw animals 
of the year 2,000, animals which had to adapt to pollution in 
order to survive. 
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Baker's clay animals. Baker's clay is a pliable substance from which 
the children were able to model endangered animal species. The 
figures were then baked and painted. 

Box environments. For this project, the students brought materials 
from hone or used objects found on the school grounds. "A cardboard 
box served as an environment for animal cutouts, twig fences, etc. 

Vegetable prints. Such vegetables as carrots, bell peppers, and 
onions were chopped in half and covered with ink on one surface. 
They were then used to imprint patterns on construction paper. 

Sandpaper prints,' The students made drawings on sandpaper and then 
filled them in with crayon. The sandpaper design was placed face- 
down on cloth (usually a T-shirt) and ironed on, creating an 
interesting effect. 

Junk sculptures or mobiles. The students were encouraged to make 
sculptures or mobiles out of ordinary objects which would otherwise 
be thrown away. 

Several of the art activities are described in more detail in 
Volume II, 

Written Exercise Treatment , The written exercise treatment utilized 
the same ecology curriculum as the discussion treatments. However, the 
students were presented the 16 questions that served as the basis for the 
discussion treatments . in booklet forms and were asked to write their answers 
to each question, (A sample booklet is presented in Volume II of the 
report.) Students were allowed 23 minutes for this task in each of the 
nine lessons. 

One problem with this treatment was that students often wanted to 
discuss the curriculum materials, but the treatment specifications pre- 
scribed that the teacher could not conduct a discussion. Therefore, it 
took a fair amount of perseverance on the student's part to do nothing 
but write answers each day. In fact, the teachers working with this 
treatment reported that they had difficulty maintaining student interest 
in the assigned task. In order to provide some reinforcement and motivation 
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for their work, the students received written comments from the ecology 
teacher? regarding their answers. Wildlife stamps were given for outstand- 
ing work. At the end of each period, they also were given an opportunity 
to compare their answers with exemprary responses. This procedure con- 
trolled for information input in the same way as the exemplary responses 

provided by the teachers did in tt^^^ 

Summary of treatments . Table 1 summarizes the five treatment conditions 
used in Study I. This table illustrates the similarities and differences 
among the treatments. 

Fidelity of Treatment 

Fidelity of treatment was investigated along two dimensions. First, a 
check was made on how closely the ecology teachers adhered to the scripted 
questions in each discussion treatment. Second, the time required to con- 
duct lessons in each treatment was checked, h c^?:>cussion of the results 
of both these checks is presented below. 

Adherence to treatment conditions . Inasmuch as the discussion treat- 
ments were semi-progranmed, adherence to the conditions of question 
sequence, probing and redirection, and filler activity was essential for 
maintenance of treatment. Likewise, in the written exercise and art 
activity treatments, it was essential that the teachers conducted no 
discussions. 

The extent to which the ecology teachers maintained the various dis- 
cussion treatment conditions was checked by audiotaping three of the 
discussions conducted by each teacher on each of the two days (Lesson 2 and 
Lesson 9.) This sample of six discussions per teacher was rated to 
establish treatment fidelity. A total of 72 discussions were rated for 
Study I. These were contained on a set of 52 audiotapes which included 
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TABLE 1 
Study I 
Treatments 



Treatment 


Content . . 


Probing and Redirection 


Curriculum materials followed by 
discussion including 4F+4MF+8HCQ 
and probing and redirection. 


No Probing and Redirection 


Curriculum materials followed by 
discussion including 4F+4MF+8HCQ 
without probing and redirection, 
and without filler activity. 


Filler Activity 


Curriculum materials followed by^ 
discussion including 4F+4MF+8HCQ 
and filler activity. 


Art Activity 


Curriculum materials followed by 
ecology-related art activity. 


Written Exercise 


Curriculum materials followed by 
written response to 4F+4MF+8HCQ. 



F = Fact question 
MF = Multi-fact question 
HCQ = Higher cognitive question 



discussions from both Studies I and II. Thirty of the tapes were scored 
by two raters. Twenty- two tapes were scored by only one rater (due to 
cost considerations). Since the tapes were assigned for scoring on a 
random basis, there is no reason to believe that the single-scored tapes 
differed systematically from the double-scored tapes. 

The audiotapes were first scored to determine whether the ecology 
teacher: 
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- asked or omitted each scripted question; 

- made substantial changes in the wording of a question; 

- asked the questions in a different order than they were listed in 
the script. 

Based upon this analysis, the teachers appear to have followed the question 
format. In only six of the 144 discussions scored for Studies I and II com- 
bined did teachers change the order of the questions. Other deviations 
either did not occur or occurred very infrequently. 

The audiotapes also were rated for frequency of several teacher 
behaviors that were considered to affect the treatment conditions. These 
included probing, redirection, praise, giving feedback concerning the 
accuracy of a student's answer, and giving all or part of an answer to 
the question (rather than the student giving the answer). Interrater 
agreement on the frequency of occurrence of these behaviors was checked 
for those audiotapes scored by both raters. The intraclass correlation 
coefficients for the raters were .93 for probing, .90 for redirection, 
.91 for praise, .65 for feedback, and .91 for giving answers. Table 2 
presents the results of teacher use of the behaviors. Most importantly, 
the use of probing -and redirection was minimal in the no probing and re- 
direction and filler activity treatments. Also, in these treatments the 
ecology teachers provided the answer for the students more frequently 
than was done in the probing and redirection treatment. This was as 
intended since the teacher giving the answer served as the mean for pro- 
viding necessary information when Probing and Redirection could not be 
used to bring out the answer from the students. 

Teachers were given only general instructions concerning use of 
praise and feedback. It appears that these reinforcement techniques 
were used more frequently in the probing and redirection treatment than 
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TABLE 2 
Study I 

Teachier Behavior Patterns in 
Discussion Treatments 





Discussi( 


Teacher Behavior 


Probing 


and 


No Probii 




Redirection 


Redirec 




N=12 teachers 


N=12 tei 




T 




X 




frequency 


S.D. 


frequency 


Lesson 2 






3.29 


Probing 


21.45 


6.88 


Redirection 


22.96 


11.34 


0.33 


Praise 


8.83 


7.46 


5.87 


Feedback 


9.50 


4.81 


5.38 


Gives Answer 


3.25 


2.46 


9.67 


Lesson 9 






1.00 


Probing 


29.92 


11.90 


Redirection 


' 24.38 


10.21 


0.54 


Priise 


8.83 


6.95 


_ 5.92 


Feedback 


8.46 


6.80 


8.58 — ^ 


Gives Answer 


. 3.75- 

,1" ' 


2.99 


9.12 
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in the other two treatments, probably because the former treatment required 
more student participation and hence more opportunity for reinforcement. 

Adherence to treatment conditions for the written exercise and art 
activity treatments was monitored by staff observations of randomly 
selected lessons. (The audiotape procedures were not used for these 
treatments because few verbal events occurred that could be scored in 
a manner that was meaningful to the study.) Generally, the prescribed 
conditions were maintained. 

Average length of treatment sessions . ^ Irf Study I, the ecology 
teachers were asked to maintain a diary in which they recorded the length 
of each treatment session which they taught. These times were compiled 
and summarized in order to determine how closely the average treatment 
times approximated the 23 minute pre-study estimate set for the probing 
and redirection and filler activity treatments, and the 13 minute estimate 
for the no probing and redirection treatment. No analysis was necessary 
for the art activity and written exercise treatments since each was 
stopped at the end of 23 minutes. 

Table 3 contains the teachers' estimated times for each treatment. In 
the filler activity treatment, the average times are for the discussion por- 
tion of the treatment only. The additional ten minutes of filler activity 
must be added to this time estimate to obtain the total treatment time. 

Based upon mean time for the treatments over all teachers and 
lessons, the expectations were met: the probing and redirection treat- 
ment averaged 23.37 minutes overall, the filler activity treatment 
averaged 23.71 minutes including the TO minutes of filler plus an 
average of 13.71 minutes of discussion, and the no probing and redirection 
treatment averaged 13.84 minutes. 
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study I 

Average Length of Discussion Treatment Sessions 





Probinq & Redirection 


No Probinq & Redirection 


Filler Activity 


Teacher 

1 bUwl 


X minutes 




X minutes 




x minutes 


S.D. 




OT Qiscussion 


S.D. 




v.D. 


of discussion 


1 




^ no 


14 11 

It» I 1 


1.45 


13.89 


.78 


2 


10 Rfi 




12 45 


1.74 


12.22 


3.38 


3 






12 78 


.97 


13.00* 


2.51 


d 




1 •03 


1^ 89 


1.06 

1 t vv 


15.89 


2.80 






^ in 


1 JtLL 


4 06 


12.44 


1.94 




24.22 


1.39 


12.67 


1 fin 

1.23 


10 C7 


71 
./I 


7 


OC 11 


9 Qfl 


10. 


1 67 


14.78 


2.11 


0 


■ 19.38* 


2.20 


15.00* 


5.35 


15.00* 


4.87 


9 


22.J5* 


3.62 


13.56 


1.13 


13.78 


1.30 


10 


25.22 


4.92 


12.78 


.67 


12.67 


1.87 


11 


21.11 


4.62 


11.44 


1.94 


10.78 


1.79 


12 


27.43** 


2.88 


17.88* 


2.64 


17.38* 


2.13 


« 

TREATMENT 


23.37 


2.46 


13.84 


1.80 


■H3'.71 


1.81 



Note; Mean based on nine lessons, except when indicated by asterisk 
* = 8 lessons; ** = 7 lessons; *** = 6 lessons 



Individual ecol>:.cjy teachers varied from the desired times. In particular. 
Teachers 7 and 12 terided tc exceed the expected 'iesson times in all the 
discussion tre.itments. Teachers 2 and 11 were low in amount of time given 
to all the discussions. However, th:* times for these teachers were within 
a reasonable approximation of the expected times for each treatment condition. 
The average times for the other eight teachers were very close to the 
expected length for each treatment. 

CURRICULUM 

Description 

The means by which the five treatments in Study I were implemented 
consisted of a specially-prepared ten-lesson ecology curriculum. An 
assumption underlying the study was that the effects of the treatments 
would not appear after a^ single discussion since students would need to 
become familiar with the questioning style of the teacher and would 
need to receive practice to permit effects to accrue. Therefore, it 
was decided to extend each treatment over ten 50-minute sessions, 
one each day, since this duration subjectively appeared to be sufficient 
for effects to emerge. 

Although a longer treatment period might have been desirable, the 
logistical constraints in this study did not permit such an extension. 
In particular, school districts might have been reluctant to permit their 
students to participate in the experimental curriculum for a longer period 
of time in place of their regular studies. 

The decision to make each lesson 50 minutes in length allowed ample 
time for organizing the classroom into treatment groFpT,'^ 
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curriculum materials, etc. Since the actual discussions and other treat- 
ment activities lasted approximately 25 minutes, the 50-minute period 
allowed approximately 15 minutes for presentation of curriculum material in 
each session and approximately 10 minutes for organizational activities. 

To insure that an identical information base existed across all 
treatments, all students in each treatment were provided with the same 
curriculum materials. The following criteria v/ere used in selecting these 
material s: 

1, They could be organized into ten lessons, one per day. The amount 
of viewing and/or reading required would be no longer than 10-15 
minutes, so that sufficient time remained for completing the 
discussions and other treatment conditions and for management 
activities. 

2, They would contain a mixture of simple facts and more complex 
ideas which could be used as a basis for generating fact and 
higher cognitive questions. 

3, They would present information which students had not already 
learned. 

4, They would cover topics perceived relevant by the participating 
school districts and consistent with their objectives. 

5, The reading difficulty would be at or below the students' 
grade level so that reading ability would not be a major 
influence on students* ability to participate in the discussion 
treatments. 

6, They would be sufficiently varied and appealing to hold the 
attention of a typical sixth-grade student for a period of 
two weeks. 

Existing curriculum materials which met these requirements in all 
respects could not be located. Therefore, a new curriculum was developed, 
using existing materials when possible. Ecology was selected as the topic 
for the unit because it was thought that it would be perceived as highly 
relevant by the participating -school districts and would appeal to sixth- 
grade students. Both these assumptions were later confirmed in practice, 
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JDbjectives for the curriculum unit were based upon Bloom's taxonomy 
of cognitive objectives (Bloom et al . , 1956). This taxonomy incorporates 
higher cognitive objectives (which were the primary concern of Study II) 
and accommodated the construction of lesson plans for the discussion and 
written treatments. 

The curriculum objectives are presented in Table 4. The objectives 
served as the basis for constructing and organizing the content of each 
lesson and for constructing the questions to which the students responded 
in oral or wfitten form. 

The curriculum included a variety of materials: printed handouts, 
a game, a film, and two film strips. A copy of each of the printed hand- 
outs is included in Volume II of this report. A description follows of 
the content and materials for each of the ten lessons. 

Warm-up Lesson . This lesson served as an introduction to succeeding 
lessons. It gave the ecology teachers and the students an opportunity to 
get acquainted and provided students with an overview of the ten-day 
curriculum. Part of the 50-minute period was spent playing an ecolagy 
board game. Cycles , developed by the Society for Visual Education 
Corporation. 

LessonJ;. Jhe film ^ What Ecoloqists. Do, - from Centron Educational 
Films provided^ tlie content for this lesson. Its primary function was to 
iffcrdaoce^'tne concept of ecology'. The film shows numerousUasteiicos of 
ecologists studying the interrelationships between organisms and their 
environments. The plight of the bald eagle is highlighted. After view- 
ing the film, the students read a brief handout summarizing the content 
of the film. 



TABLE 4 

Objectives of the Experimental Curriculum Unit 

As a result of exposure to the curriculum unit, the student should 
be able to: 
Knowl edge 

1. state facts about the natural environment; balances that exist 
in nature; man's contribution to imbalances and to environmental 
pollution; and solutions to correct imbalances and pollution. 

Analysis 

2. give reasons to explain why changes occur in the natural 
environment. 

3. give evidence to support these generalizations: 

- all things in nature depend on each other 

- man's actions can affect the natural environment 

- changes in the natural environment can set off a chain 
reaction that upsets the balance of nature 

- we need to take care of our natural environment. 

4. infer the above generalizations when presented with appropriate 
data. 

Synthesis . 

5. develop defensible solutions to the problem of preserving and 
improving the environment. 

6. *^^>e predictions about consequences of changes in the natural 

. ironment. 

Evaluation 

7. state reasoned opinions concerning the proper relationship 
between man and the environment. 
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Lesson 2 . This was the first lesson in which the curriculum materials 
were in a written format. The content of the lesson was derived from a 
variety of sources. It focused on DDT and insect poisons. Building on 
concepts introduced in the previous lesson. Lesson 2 emphasized the un- 
anticipated consequences of introducing dangerous new elements into the 
environment. 

Lesson 3 . A filmstrip. Nature's Balance , produced by Visual Education 
Consultants Corporation, provided the content for this lesson. Several 
additions and clarifications were made in the filmstrip's text to make it 
suitable for sixth grade students. The focus was on the interconnectedness 
of all living things; that is, the balance of nature and how easily it can 
be upset by the introduction of a foreign animal species. 

Lesson 4 . As with all of the other written lessons, this lesson on 
wolves was supplemented with photographs and illustrations. It was adapted 
from a chapter in Wildlife in Danger by Ivan Green. The lesson was a case 
study of the wolf as an animal facing the imminent threat of extinction. 
The question of what could be done to remedy this situation was left open- 
ended for students. 

Lesson 5 . This lesson was adapted from the article "What Good's a 
Gator?" in Xerox's Nature and Needs series, and updated with recent 
information on the rapidly increasing population of alligators. The 
importance of the alligator for the survival of all swampland animals 
was stressed, and man's responsibility as the gator's only natural enemy 
was discussed. 
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Lesson 6. This lesson-, also in a written format, provided a bridge 
between the preceding lessons on the interrelationships in nature and 
subsequent lessons on manmade pollution. Its central theme was the value 
of our natural resources and how they had been abused. Respect for resources 
in our modern world was contrasted with that of the Native American. A 
variety of source materials was used in preparing this lesson. 

Lesson 7 . The visual component of this lesson was a Society for 
Visual Education filmstrip entitled The Air Pollution Menace . The text 
portion of the filmstrip was rewritten at the sixth grade vocabulary level. 
The filmstrip' s central theme was that despite recent legislation, the air 
pollution problem continues to worsen. 

Lesson 8 . The lesson on ocean pollution was written utilizing 
various resource materials. The lesson demonstrated how the ocean's 
natural balance is upset by the dumping of sewage. The problems created 
by oil and chemical pollution, and the responsibility of industry were 
also discussed. 

Lesson 9. The final lesson, entitled Peaceful Lake , was adapted 
from the Ecosystems curriculum developed by Science Curriculum Improvement 
Study. It was selected as the culminating leson because in presenting 
the history of Lake Erie (Peaceful Lake), this article tied together most 
of the major concepts of the ecology unit. 

The lessons which included a film or filmstrip were presented to 
students in their regular classroom because they broke into treatment 
groups. All other lessons were presented to students after they had 
assembled in their respective treatment groups. 
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In addition to the materials outlined above, a set of 16 questions 
was developed for each lesson. These questions were to be used by the 
teacher during the discussion portion of the lesson and/or to be responded 
to in writing by the students. The types of questions and the criteria 
for their selection were discussed in the previous section under treatment 
conditions. A complete list of the questions for each lesson is contained 
in Volume II of this report. 

Pilot Testing 

The curriculum materials and the various treatment conditions for each 
lesson underwent two pilot tests. The first test was conducted in October 
1973 in a school in San Francisco. It involved five of the lessons that 
ultimately were included in the study. The second test was conducted in 
January and February 1974 in Castro Valley, California and included all 
the lessons. 

The pilot- testing had three purposes: 

. - to determine whether the reading level of the curricular materials 
was appropriate for sixth grade students; 

- to test the clarity of the questions asked during the discussion 
portion of the treatment; 

- to test the procedure of controlling number of probes and redirections 
versus the procedure of controlling total discussion time in the 
probing and redirection treatment. 

The 12 students who participated in the first pilot test generally 
were one to two years behind in reading achievement. Eleven students 
were members of ethnic minority groups. The five lessons that were tested 
with them were presented on five consecutive days. The procedures employed 
required the students to read the curriculum selection silently, then 
follow along as the teacher (the Laboratory staff member conducting the 
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piloting) read them. Visuals were used to illustrate some of the major 
concepts. Oral questioning followed. At the end of the five-lesson 
sequence, an oral post-test consisting of six higher cognitive questions 
was administered individually to each student. The outcomes of this pilot 
suggested that the reading level of the materials was too difficult and 
that a unit consisting of more than five lessons would be required if 
students were to develop skill in respc ding orally to higher cognitive 
questions. 

The second pilot test was conducted in a sixth grade class in a 
school serving a suburban middle-class population. It involved all 
the lessons in the ecology unit including the warm-up lesson. 

For this test, three groups of six students each were randomly 
selected from one classroom. Three teachers (Laboratory staff members) 
were assigned to teach the lessons, one to each group. ^ Audiotape record- 
ings'~were made of each discussion session so that the effectiveness of 
the semi -programmed questioning sequence and the use of probes and 
redirections could be studied in detail. An instructional strategy based 
upon a highly structured method of calling on students (one that controlled 
the number of times each student was called upon) also was tested. 

The results of the second pilot indicated that the reading level of 
the materials was appropriate for students whose reading achievement was 
at, or near, the sixth-grade level. However, additional illustrative 
materials were needed, particularly charts and line drawings illustrating 
critical concepts in the units. 

Review of the audio-recordings of the lessons suggested that the 
semi -programmed questions asked during the discussions were frequently 



80 



37 



too wordy and used vocabulary that was beyond the students* language level. 
It further suggested that exact control of the njmber of times a teacher 
probed and redirected created an unnatural situation, as did the structured 
method of calling on students. On the other hand, lack of exact procedures 
to follow in using probing and redirection resulted in considerable 
variation in the length of discussions both between teachers and between 
lessons. Attention and motivation problems associated with an imbalance 
in male-female group membership also were identified. 

These findings led, first of all, to the equalizing of males and 
females (3+3) as much as possible within the treatment groups of Study I. 
Also, the semi -programmed discussion questions were rewritten using fewer 
words and simpler vocabulary. Charts and illustrations were added to the 
units. The sequence of the lessons was changed. The decision was made 
to provide some guidelines for the use of probing and redirection by 
indicating which questions should be probed and redirected and for how 
many times, but not designating which students should be asked to respond 
to these follow-up requests. At the end of this revision, the curriculum 
materials weVe" judged to be ready for use in Study I. 

i 

STUDENTS AND TEACHERS 

Students 

In both Study I and Study II it was important to work with students who 
had sufficient reading skills to use the ecology unit 'materials effectively. 
The sixth grade, therefore, was selected as the grade level at which the 
study would be conducted. 
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Study I was conducted in the San Lorenzo Unified School District, 
San Lorenzo, California. Recruitment of the school sites included con- 
tact with the district administration followed by meetings with the 
elementary school principals to explain the nature of the study. Six 
principals offered to determine whether their sixth-grade teachers would 
agree to have their students participate. A total of 12 sixth-grade 
classes, two in each of six schools, volunteered. A total of 336 
students from these classes served as the sample for the stydy. 

Since the reading level of the students was considered important 
to the use of the curriculum materials, information was obtained con- 
cerning the students' scores on a state-administered reading test, the 
Comprehensive Tests of Basic Skills. This test was administered at the 
beginning of the school year in which the study was conducted. Table 5 
presents the mean score and grade equivalent for all the students 
participating in the study. 



TABLE 5 
Study I 

Mean Reading Scores of Students 









VOCABULARY PLUS 


VOCABULARY 




COMPREHENSION 


COMPREHENSION 




Grade* 


Grade 


Grade 


X S.D. 


Equiv. 


X S.D. Equiv. 


X" S.D. Equiv 


27.42 (8.07) 


5.3 


27.85 (9.37) 5.1 


55.27 (16.61) 5.2 



* Grade equivalents obtained from Examiner's Manual, Comprehends ive Tests 
of Basic Skills. Monterey, California: McGraw-Hill, 1968, pages 48-49. 
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While the average score for the students at the beginning of the 
year was below the sixth grade-level, it was determined that the students 
could be expected to read and understand the curriculum materials. The 
time period in which the study was co^ ^d— March and April 1974-- 
further contributed to this expectat :e the students had completed 

an additional six months of schooling from the date of the state testing. 

T eachers 

A total 2 teachers participated in Study I. These teachers 
were recruited from a group of 100 teachers selected at random from the 
substitute teacher list of the San Francisco Unified School District. 
Eleven of the teachers were female. Eleven were white. Their average 
years of teaching experience ranged from 0 to 7 years. 

Procedures used to recruit and train the teachers are described 
below. 

Recruitment . As was stated above, the teachers were recruited from 
among the substitute teachers in the San Francisco Unified School District 

Letters of invitation to serve as a teacher in the study were sent 
to the TOO teachers selected at random from the substitute list. Thirty- 
one responses were received. Each respondent was interviewed by two of 
the researchers on the study. Fifteen of these teachers were selected 
to receive training. The criteria for selection included: (a) 
possession of a California teaching credential, and (b) experience 
teaching children of upper-elementary age. 

Training ! A five-day training program was conducted. The purposes 
were to acquaint the teachers with the study, to introduce them to the 
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various treatment formats, and to provide practice in conducting the 
various treatments. 

The training began with a series of seminars conducted at the Far 
West Laboratory by the research staff. In these seminars the teachers 
were given an overview of the study. The various treatments were dis- 
cussed in detail. The curriculum unit was explained. Aspects of skillful 
questioning were treated extensively, particularly those covered in 
Minicourses 1 and 9 (see Appendix A for an overview of these training 
programs). In addition, the teachers role-played the various discussion 
treatment formats until all felt comfortaLle conducting each treatment. 

Following the seminars, three days of training were conducted in 
local schools which were not involved in the actual study. For the first 
two days the teachers worked in pairs. As one teacher conducted a discussion 
treatment format with a small group of six students (a condition similar 
to that included in the study), the partner recorded the lesson 
on a cassette recorder and took notes rega>-ding the strengths and weaknesses 
of the lesson. These roles Were switched after each lesson- At the end 
of each day, the audio recordings and notes were reviewed by the teachers 
and Laboratory staff to determine the correspondence of the lessons to 
the treatment conditions. 

On the third day of work in the schools, the teachers worked individual! 
as they would in the actual study. 

The final selection of the 12 teachers for Study I was made on the 
basis of each teacher's ability to follow treatment guidelines while 
still maintaining a warm atmosphere in the discussion group. Effective 
use of the feedback techniques of probing and redirection also was 
a selection criteria. 
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Once Study I began, a refresher training session was held mid-way 
through the sequence of ten lessons to discuss ways to improve fidelity 
of treatments and ways to handle discipline problems. 

The extent to which this training was effective is indicated by the 
fidelity of treatin^^nt information presented in the previous section. 

INSTRUMENTATION 

In order to study the effects of teacher use of probing and re- 
direction upon student learning, two aspects of student performance were 
investigated. These were: (a) student achievement at both fact recall 
and higher cognitive levels and in terms of both written and oral 
modalities; and (b) student attitudes concerning the variOM? tfcjatment 
parameters. A total of seve' achievement measures and six attitude 
measures were used in the study. Every student--irrospective of treat- 
ments-completed the same set of tests with the exception of the treatment- 
specific attitude scales. The particular version of thirst: scales which 
was completed by the students depended on the treatment in which they 
participated. 

Tables 6 and 7 list the achievement and attitude instr'-i^ents- 
respectively. These tables also include he specific Vciriibies measurec: 
by each instrument and the point of administration in the stLi?y. Copies 
of each instrument are contained in Volume III of the report. 
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^N^lPUMENTS 



^2%r^hensive Tests of 
^^^^ Skills-Reading 



Ec 



jl^]ogy Information 



^^^] test 



Es 



^i^.. Test 



'^^f^l^iation Test 



§^^^ti°n-Generating Test: 
"^^t^ft^^.and-Pencil Measure 



^^^^^^^I'on-Generating Test: 
^^^] (vlt sure 



TABLE 6 
Study I 
Achievement Measures 



VARIABLES MEASURED 



Vocabulary; Comprehension 



POINT OF 
ADMINISTRATION 



Pre^ 



Amount of information 
about ecology 



Pre, post, 
del ayed 



Ability to state orally 
opinions, predictions, 
solutions, inferences, etc, 



Abil ity to state in 
writing opinions, pre- 
dictions, solutions, 
inferences, etc. 

Ability to state in 
writing reasons and 
if-then relationships. 



Ability to state in 
writing opinions, or- 
dictions, solutions, 
inferences, etc. Ability 
to state in writing 
reasons and if-then 
relationships. 



Pre, post 



Pre, post 



Delayed 



Ability to generate 
questions Qual ity of 
questions generated. 



Abil ity to generate 
questions. Quality 
of questions generated. 



Pre, post 



Pre, post 



approxim:.te 

TESTING TIMe2 



52 minutes 



15 minutes 



10 minutes 



25 minutes 



25 minutes 



20 minutes 



2 minutes 



EKLC 



collectrd by the participating school districts, not by the 
^^5^archers. 

heS^ a^''^ si^^^age tin:es for test' admihi station. Al 1 tests "except the QuestTon 
^^p^rating Test (Paper-and-Pencil Measure) were primarily power tests. 
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TABLE 7 
Study I 



Attitude Scales 



SCALE 


VARIABLES MEASURED 


POINT OF 
ADMINISTRATION 


APPROXIMATE 
TESTING TIME 


Word Association Scale 


Attitude toward 
ecological concerns 


Pre, post 


10 minutes 


Gall -Crown Discussion 
Attitude Scale 


Attitude toward 
class discussions 

Attitude toward 
thought questions 


Pre, post 


15 minutes 


Ecology Unit Opinions 


Attitude toward treat- 
ment group Peers 

Attitude toward 
escology teacher 

Attitude toward 
ecology curriculum 


Post 


15 minutes 


Ecology Discussion 
Attitude Scale 


Attitude toward 
discussion treatments 

Attitude toward 
thought questions in 
discussion treatments 


Post 


15 fr)ir;r -^:;5 


Written Exercise 
Attitude Scale 


Attitude toward 
Written exercises 
in the written 
exercise treatment 


Post 


15 minutes 


Ecology Art Project 
Scale 

i 


Attitude toward art 
activities in the 
art activity 
treatment 


Post 


10 Hiinutes 
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The seven achievement measures used in the study included one 
'"^asure of general verbaT^abji Jty and six measures of fact and higher 
Cognitive outcom^g related to the curriculum unit. A discussion of each 
Of ^hese instruments follows. 

£omprehen£j^Tests_of SkilU (CTBS). The verbal ability score 

^'"Om the Comprehensive Tests of Ba'^ic Skills (Form Q-Level 2) was used 

g, measure of students" vocabulary and comprehension levels. These 
Scopes were obta-jj^ed the school district based upon the October, 1973 
statewide testing program. 

Two scales, ocabulary items) and Comprehension (45 items), from 
^!^<c reading sect-jQp of the CTBS were used. The correlation between the 
Vocabulary and CQ,^prehension scales for the student sample in Study I 
Was .79. T*^^ correlations of the scales with other variables in the 
^tu^iy are reported in Volume iv of this report. According to the test 
^^tnir.istra tor's ^^gpual for t^e CTBS, the Kuder-Richardson 20 coefficients 
'^f internal cons-jgtency for ^j^e Vocabulary and Comprehension scales are 
•93 and -92, '"esp)gctively. -j-he errors of measurement for raw scores are 
2.42 and 2.73, respectively.* 

Ecolog)LillFQrrnat^^ (EIT). The Ecology Information Test was 
^^signed to meas^^^g students' acquisition of factual information con- 
^^ined in the ecQ-]ogy curricij-]um. The test was constructed from a 
""^ndomly drawn s^j^get of facts obtained by a content analysis of the 
^^oiogy curricul^j^ unit and the semi -programmed questions included in 
^^e discussion treatments. 

* see Comprehet^give Tests of Basic Skills, Technical Report, Page 32. 
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The EIT contains 27 multiple-choice (fou^ alternative) items with 
directions to the student to select the "best" option. For Study I, 
these items were divided into two subtests. The Intentional Scale con- 
tains 10 items measuring students' ability to recall information covered 
in the semi -programmed questions asked by the teacher. The Incidental 
Scale measures students' recall of information not covered in the 
teacher's questions but included in other unit materials. Differential 
effects on these two types of items have been found consistently in 
research on prose learning (Anderson, 1975). Therefore, it seemed worth- 
while to include them as separate dependent measures in this study. 

It should be noted that the items in Intentional Scale I are 
"intentional" for the discussion and written exercise treatments, but 
"incidental" for the art activity treatment s;,,^e this treatment did not 
receive questions of any type. The items in Incidental Scale I are 
"incidental" for all treatments. 

The test was administered before, immediately after, and seve.dl 
weeks after the study treatments were completed in order to t^^st both 
knowledge acquisition and retention. 

The intercorrelations among the sub scales of the EIT are included 
in Table B-1 , Appendix B, of this volume. Their correlations with other 
variables in the study and item statistics calculated separately for 
each treatment forvpre, post, and delayed administrations are contained 
in Volume IV of ithis report. The item statistics include information 
concerning: (a); sample si-o. itt'n difficulty, (c) adjusted item 
difficulty calculated on the subset of students whn answered the item, 
(d) point-b1 serial correlation of item score- ^^ith total scores, , 
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(e) the number of items in each subtest, (f) mean test or subtest score, 
(g) standard deviation, (h) alpha coefficient, and (i) standard error 
of measurement. 

The standard errors of measurement and internal consistency co- 
efficients for the test as a whole and the subscales are reported in 
Table B-2, Appendix B for each administration within each treatment. 

Oral Test (OT). The Oral Test measures students' ability to give 
plausible, reasoned oral responses to higher cognitive questions about 
the ecology curriculum. 

The six higher cognitive questions in the test were representative 
of the question types used in the discussion treatments. Table 8 
indicates the classification of each question in Bloom's Taxonomy and 
the derivation of each question from its treatment source. The items 
were constructed, pilot-tested, and revised as part of the pilot-testing 
of the curriculum (see previous section for explanation of this pilot test). 
Copies of the test, administration instructions, and the scoring manual 
are available in Volume III of this report. 

The Oral Test was administered individually to each student. Students* 
responses were audiotaped to be rated later. The teachers hired for the 
study administered the test. For posttest administration, the teachers 
worked in classrooms in which they had not taught the unit in order to 
reduce bias due to teacher familiarity with students. 

Each item in the Oral Test was scored by trained raters on two scales: 

- content--the number of predictions, solutions, supported opinions, 
explanations, and inferences given by the student. 

- logical extension— the number of "because'* and "if-then" relationships 
supplied by the student. 

o 
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TABU' 



Stu 



Derivation of 0 Items 

^^^\^\^ AMD/OR CURR^^ SOURCE 



ITEM NO. 


CLASSIFICATION 


2 


Prediction 


3 


Solution 


4 


Explanation 


5 


Opinion 

-+ ^ 


6 


Opinion 


7 


General ization 




rKHion treatment), \evt^^r^s to ^nY 
H\)f lesson 7. 

f^^&d version of a c^gstion whic^, 
%d ""^ Lesson ' • 

^^?t3ticn tr^^-tmet^Jg for i-essor, 

^^cU^ofial question {lf,cl"dedj_" 
r-^ H°on treatments tj;: tesson 8). 



^rrL°r.n^4' Question whic^, 



\^ in Lesson 

IJ^UK^T question. \^ta\n^ t° ^Q^^gnt 
oi 9. 
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The correlations between these variables and their correlations with other 
variables in the study are reported in Table B-3 (Appendix B), and in 
Volume IV, respectively. 

Because of the nature of this instrument, two additional aspects 

■ i... 

of its administration and scoring must be considered. One is the pro- 
cedures and interrater reliability for the rating of the audiotapes of 
students' responses. The second is the effects upon the ratings of 
cues on the tapes regarding the time of test administration. 

Rating procedures . Six raters were trained to a satisfactory 
level of performance using a set of "training tapes." These raters then 
were randomly paired and each pair was randomly assigned a set of audio- 
tapes to rate. 

Iiicerrater reliability was calculated by the intraclass correlation- 

coefficient across all pairs of*raters. Separate coefficients were 
computed for pre and post tapes for Study I and study II. On the Content 
Scale, the coefficients ranged from .80 to .84, indicating high inter- 
rater agreement. For the Logical Extension Scale, in Study I, the pretape 
coefficient was -67. The posttape coefficient was .77. 

Effects of cues . Although the raters at no time were told which 
classroom or treatment group they were rating, the audiotapes contained 
some :atements by the tester that identified the point of administration. 
For example, a tester might remark, "Don't worry; you'll learn more 
about this later." Raters were instructed to note on their forms when 
such an indicator was present. The rating forms were analyzed to deter- 
mine the freq-'-ncy and distribution of these indicators. In Study I, 
indicators were 'relatively infrequent. Table 9 summarizes these data. 
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TREATMENT 



TABL^ g 
Stud^ J 

Percentage o' ^1 fes pre-Post Indicator 

^%^0^^^^^5^Slt3AVINR PRE^dSTTNDICATOR 







Probing and Redirection 


0 


No Probing or Redirect'"''^ 


0 


Filler Activity 


0 


Art Activity I 


0 


Written Exercise 


0 




A supplemental anaiy^^' d^"^^ * ^^t^rn^'ne whether the indicators 

^^K, ^ 0^ ^^^^^ 



influenced raters to asS 

ans>» compare 



^co^es than if the indicators 
had not been present- ^ the raters' mean rating of 



>hei^ rating 

indicator posttapes with ^ ^ti^a<^ ^ non-indicator posttapes 

within the same treatmen^E^- ^ ^eS^ ^ ^}^om in Table 10, There 

are no significant diff^^^'^ ^ 1ri "(^^^^^^ ^^^^6 upon presence or absence 

of indicators. FurtherJ^^'^^' ^^hsi^^ent directional differences 

^ f ^h --^ ' 

between the two conditio"^' ^^ul*^ ^ ^v-al Test in Study I do not 

appear to have been affe'^*' ^ the audiotapes of point of 

administration of the t^^^' 

Essay Test . The foL"^**^ ^^hi'e^^'"^"^ '^^^Syre was the Essay Test. 

The purpose of this test ^^^^ rfl^''^"'^^^ ^^^^^nts' ability to give plausible* 

reasoned, written response^ ^^e^^^°^ ^^^Ut the ecology curriculum. 

The tei:t contained only ^^^^^^^^^^5 ca^^^"^ ^o^ 0re than simple recall 

of information. The de^i^^l^^^ 0^ *'^^„^."^^^''onS and their relation to 
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TABLE 10 



^ 1.96, P 



Study I 




p conpan'son of Oral Test Posttest Ratings for 
■^H'l Indicator Present versus "Post" Indicator Absent 



^^^^If^G AND REDIRECTION 
TREATMENT 



^0 4.00 2.79 



^0 3.57 1.91 



8.35 2.79 



^3 8.75 2.59 



t* 



0.59 



0.45 



NO PROBING AND RE- 
DIRECTION TREATMENT 



No. of J 
Tapes rating $.]], 



6 3.25 2.34 



55 3.33 2.22 



6 7.83 0.93 



57 7.69 2.68 



0.08 



0.12 



FILLER ACTIVITY 
TREATMENT 



No. of J 
Tapes rating s.D. 



6 3.50 2.55 



60 2.98 2.25 



6 5.75 1 .1 



62 7.65 , 2.59 



0.52 



1.73 
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the curriculum are presented in Table 11. These questions also were con- 
structed, pilot-tested and revised as part of the pilot-testing of the 
curriculum unit. 

The Essay Test and the other free-response measures of higher cognitive 
processes (Oral Test and Transfer Test) were untimed to allow students 
sufficient opportunity to organize and communicate their ideas. Pilot test- 
ing was done to determine the amount of space un the test form which students 
needed in order to respond to each item in full. Students typically did not 
write essay-type responses to' the questions, although given the opportunity 
to do so. Thus, the label "short-answer test" might be a more appropriate 
description of this measure than the label "Essay Test" by which it was 
designated in the study. 

Because the test was long for some students, it was anticipated that 
they might respond better on items appearing early in the test relative to 
later items. Therefore, to control for item order effects, two forms of the 
test were constructed so that the item order was reversed on the second form. 
The different test forms were administered randomly to students. 

The scoring of the Essay Test was in two steps. First, each response 
was judged to be relevant or not relevant to the question. Second, for the 
group of relevant responses, each response was scored by trained raters on 
two scales: 

- content: the number of plausible predictions, solutions, supported 
opinions, explanations, and/or inferences provided. 

- logical extension : the number of "because" and "if-then" relation- 
ships provided. 

The correlations between each scale are presented in Table B-4 of Appendix B. 
Their correlations with other variables in the study are reported in Volume 
IV. Volume III contains a copy of the instrument and scoring procedures. 
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TABLE n 
Study I 

Derivation of Essay Test Items 



ITEM NO. CLASSIFICATION TREATMENT AND/OR CURRICULUM SOURCE 



1 


General ization 


Incidental question (not included in any 
uiscussion urcauiHcnuy* rcrudinb uu 
content of Lesson 7. 


2 


General ization 


riOujTieu version or a quesuion wmcri 
appeared in all discussion treatments 
for Lesson 7. 


3 


General ization 


Incidental question. Pertains to 
Lesson 8. 


4 


Opinion 


Incidental question. Pertains to 
content of Lesson 5. 


5 


Interpretation 


intenLionai quesuion lor LCbbon 


6 


Solution 


incidental question. Pertains to 
con ten L or Lesson o • 


7 


Explanation 


Incidental question for Lesson 7. 


8 


Opinion 


Incidental question for Lesson 5. 


9 


Opinion 


' Mocfified version of a question which 
— -appeared in all discussion treatments 
- for Lesson 6. 


10 


Prediction 


Modified version of a question which 
appeared in all discussion treatments 
for Lesson 2. 


n 


Solution 


Incidental question for Lesson 1.. 


12 


Opinion 


Incidental question. Pertains to 
content of Lesson 1. 
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Five raters scored the Essay Test. Interrater reliability calculated 
by the intraclass correlation coefficient across all pairs of raters for 
both Study I and Study II was high for the Content Scale, ranging from .86 
to ,90, In Study I the coefficients for the Logical Extension Scale were 
•70 for the pretest and ,72 for the posttest. 

Because the pairs of raters were assigned test folders containing all 
the pretests or posttests for a particular classroom, it was important 
to check for a rater-by-classroom interaction based upon possible leniency 
on the part of some rater-pairs. The presence of this interaction was 
tested by analyzing a randomly drawn subset of 20 tests which the five 
raters had scored independently during refresher training. Their mean 
ratings on the Content Scale and the Logical Extension Scale were com- 
pared using a one-way analysis of variance. The F values for the Content 
Scale (F=.94), and the Logical Extension Scale (F=.79) did not reach 
statistical significance. 

Transfer (Population) Test . The purpose of the Transfer Test was to 
determine whether higher cognitive response skills would transfer to a 
new, unstudied curriculum topic. The chosen topic was the problem of 
human population explosion. 

The test consisted of nine higher-cognitive questions for which 
students wrote brief essay answers. The questions were representative 
of the types of higher cognitive questions used in the discussion treat- 
ments. Three questions solicited a supported opinion, two solicited a 
prediction,^ two an explanation, one a solution, and one an interpretation. 

The scheme for scoring this test was similar to that used for the 
Oral and Essay Tests. The correlation between the Content and Logical 
Extension Scales was .65 in Study I. Correlations with other variables 
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in the study are reported in Voluine IV. Volume HI contains a copy of the 
instrument and the scoring procedures. 

Interrater reliability for scoring this test was high: .87 for the 
Content Scale and .86 for the Logical Extention Scale. No significant rater- 
by-classroom interaction was found. F values for a one-way analysis of 
variance based upon mean ratings of 20 randomly selected tests which the 
five raters had scored independently during refresher training are 
Content Analysis, F=.09, and Logical Extension, F=.15. 

Question-Generating Test (Paper and Pencil). The question-generating 
test asks students to generate as many questions about pollution and wild- 
life as they can in twenty minutes (ten minutes for each topic). It was 
administered in two forms— the paper and pencil version discussed here 
and the oral version, the discussion of which follows in the next section. 

Scores on this test were used to test whether the models of question- 
ing presented by the teachers in the various treatments influenced students' 
question-generating behavior. 

The tests were scored independently by two raters on the following 

variables: 

- Number of non-pertinent questions, that is, questions which did not 
relate to pollution or wildlife. 

- Number of pertinent questions, that is, questions which related 
directly to pollution and wildlife. 

- Quality rating. Each pertinent question was rated on a three-point 
quality scale. Common fact .questions were rated "1," common higher 
cognitive questions were rated "2," and original higher-cogmtive 
questions were rated "3." 

- Number of Specific Questions. Each pertinent question was rated 
according to whether or not it referred to a specific aspect of 
pollution of wildlife. 

- Number of Requests for Rationale. The sum of "Why?" "Why, or why 
not?" "Explain," or similar statements which followed questions. 
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A copy of the test and scoring manual are presented in Volume III 
of the report. The intercorrelations between the five scales are shown 
in Table B-5 of Appendix B of this volume. Their correlations with other 
variables in the studies are reported in Volume IV. Intraclass corre- 
lations for reliability of the rating across all pairs of raters also 
are reported in Table B-6 of Appendix B. 

Question Generating Test (Oral) . The oral question generating test 
was similar to the written version except that a different set of ques- 
tions was asked orally and the responses were given orally. These 
questions were asked and audiotaped at the same time as the administration 
of the Oral Test (see p. 46). Each audiotape was rated for frequency 
of nonpertinent and pertinent questions and for overall quality using 
the same criteria used in the paper-and-pencil version. 

Interrater reliability based upon intraclass correlation coefficients 
across all raters ranged from .84 to .92 for pertinent questions; .80 
to .86 for quality rating; and .62 for non-pertinent questions on the 
pretest and .83 for the posttest tapes. 

Correlations between the variables measured by this test are pre- 
sented in Table B-7 of Appendix B. Correlations with other variables 
in the <^tudy are in Volume IV. A copy of the test and scoring manual 
are presented in Volume III of the report. 

As with the Oral Test, the appearance of "post" indicators on the 
audiotapes also might bias the ratings on this test. However, Table 12 
indicates that the Study I data were not influenced by this factor. 
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TABLE 12 



Study I 

Comparison of Question-Generating Test (Oral) Posttest 
"Post" Indicator Present versus "Post" Indicator / 



VARIABLE . 


INDICATOR 


Probing and Redirection 
Treatment 


No Probing and Re- 
direction Treatmeni 


No. of X 

Tapes ratinq s.n. 


t* 


No. of "x 

Tapes ratinq <;.n^ 


NON- 
PERTINENT 
QUESTIONS 


Present 


10 0.30 0.95 


0.14 


6 0.08 0.20 


Absent 


52 0.34 0.78 


56 0.10 0.48 


PERTINENT 
QUESTIONS" 


Present 


10 1.30 1.18 


0.19 


6 2.08 1.11 


Absent 


52 1.39 1.35 


56 1.78 1.22 


QUALITY 
RATING 


Present 


10 1.04 0.80 


1.18 


6 1.28 0.75 


Absent 


52 0.76 0.65 


56 0.97 0.56 



n = 1 .95, p£.05 



Attitud e Scales 

Six attitude measures were used in the study. Three of these measures 
were administered to all of the students regardless of the treatment group 
to which they were assigned. The other three . measured w^ related to 
students^ attitude toward the specific treatment in which they participated. 

Word Association Scale. The Word Association Scale measured students' 
attitudes toward the major ecological topics covered in the ecology curri- 
culum unit. It was administered to all students pre and post treatinent. 

The scale dealt with attitudes toward the topics: balance of nature, 
ecology, alligators, wolves, air pollution, and water pollution. Ten 
b.i-polar adjectives from the evaluative factor (Osgood, Suci , & Tannenbaum, 
1957) were applied to each topic. Students indicated their attitude on each 
scale by marking on a seven-point scale anchored by the evaluative 
descriptors. The scales for four topics were scored so that a positive 
ecological attitude was represented by a high score. For two topics 
(air pollution and water pollution), the scoring was reversed so that a 
high score indicated a negative attitude. It should be noted, however, 
that the bi-polar scales of important-unimportant and interesting-dull 
were not reversed on these topics since it was thought that students 
might have a negative attitude toward pollution, yet find it interesting 
and important. 

A copy of the Word Association Scale, scoring keys, and item statistics 
are contained in Volume III. 

The intercorrelations of the scales, and the internal consistency 
coefficients and standard errors of measurement for each scale for each 
treatment are reported in Tables B-8 and B-9, respectively, of Appendix B., 
Their correlations with other variables in the study are presented in Volume IV. 
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np^n-Crown Discuss ion Attitude Scale (GDAS) . The GDAS measured students' 
attitudes toward: (a) class discussions in general, and (b) questions call- 
ing for responses more complex than simple recall. It was admi nisteret?? to 
all students pre and delayed. 

The GDAS consisted of two subscales: one of 19 items measuring atti- 
tude toward discussion-, the other of 11 items measuring attitude toward 
higher cognitive questions. All items used a four-point Likert respo-.se 
format and were randomly ordered. Each subscale contained both positive 
and negative items to avoid the problem of an acquiescent response set. 

As with the other instruments, the intercorrelations of the scales 
and the alpha coefficients and standard errors of measurement are reported 
in Tables B-10 and B-11 of Appendix B. Volume III contains a copy of the 
scale, scoring keys, and item statistics. Volume IV reports correlations 
of the scale with other variables in the study. 

Ecology Unit Opinion Scaled (EUOS) . The EUOS measured students' 

attitudes toward other students in the treatment group (5 items), 

attitude toward the ecology teacher (16 items), and attitude toward 
the ecology curriculum (9 items). It was administered to all students 
regardless of treatment as a post measure only. 

Items in this scale also use a four-point Likert response format 
and are randomly ordered. The various statistics related to the instru- 
ment are reported in Tables B-12 and B-13 of Appendix B and Volume IV. 
Copies of the scale, scoring keys, and detailed item statistics are 

contained in Volume III. 

Fcoloav Discussinn Attitude Scale (EDAS) . This instrument relates 
only to those treatments in which students participated in group dis- ; 
cussions. It measures students' attitudes toward: (a) the discussion 



104 



proeeiV-used' in' t^^^^^^ (b) questions requiring higher 

cognitive responses. 

The items in this scale parallel items from the GDAS in order to 
facilitate comparisons between the scales. The two subscales contained 
a likf:^ number of items as the subscales in the GDAS— 19 items related to 
discussion, 11 items related to higher cognitive questions. A fouf-point 
Likert response format was used. Items were randomly ordered in the com- 
plete instrument and each subscale contained a mixture of positive and 
negative items. 

Refer to Tables B-14 and B-15 of Appendix B of this report. Volume III 
for a copy of the instrument, and Volume IV for technical statistics re- 
garding the instrument. 

Written Exercise Attitude Scales (WEAS) . The WEAS was administered 
only to the students in Study I who completed the written exercise treat- 
ment. It measured students' attitudes toward: (a) completing written 
exercises; and (b) written questions requiring higher cognitive responses. 

The WEAS contains two subscales— 12 items related to written exercises, 
11 items related to thought questions. All Uems use a four-point Likert 
response format and are randomly ordered in the complete instrument. Each 
subscale contains a mixture of positive and negative items. The inter- 
correlation between, the two subscales was .76. For the Attitude Toward. 
Written Exercises subscaie^ th^ coefficient of internal consistency (alpha) 
was .88 and the standard error of measurement was 2.55. For the Attitude 
Toward Thought Questions subscale, the internal consistency coefficient 
(alpha) was .86 and the standard error of measurement was 2.48. 

Ecology Art Project Scale (EARS) . This scale was administered as 
a post measure to only those students in the art activity treatment. 
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It measured students' attitude toward the art activities. It consisted 
of 19 four-point Li keirt items with a mixture of positive and negative 
items. See Table B-16 of Appendix B in this report and Volumes III and 
IV for further technical information regarding the instrument. 
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RESEARCH DESIGN 



The primary purpose of Study I was to test the effects of four different 
instructional treatments (probing and redirection, no probing and redirection, 
filler activity, and art activity) on student achievement and attitudes. A 
fifth treatment (written exercise treatment) was provided for those pupils 
in each classroom who were not included in the research design. 

The nature of the discussion treatments precluded use of a factorial 
experimental design in which the factors of ecology teacher and treatment 
would be crossed. Since each ecology teacher could instruct only four treat- 
ment groups during a school day, the cell size in a factorial design would 
have been limited to two cases.* While the experiment could have been 
replicated to gain statistical power from a larger sample, this had several 
disadvantages: logistically, it would have bean difficult to achieve; also, 
the possible effects of teaching practice and time of year would have been 
uncontrolled and difficult to measure. 

Another concern was whether a crossed-effects des.,ign would achieve 
the research objectives. Such a design is uniquely appropriate for investi- 
gating interactions between main effects. However, since the ecology 
teachers were to be trained to follow a prescribed set of treatments, it 
did not seem likely that there would be teacher by treatment interactions. 
Therefore, it seemed appropriate to use a Latin square design, which does 
not allow for investigation of interaction effects, but which provides the 
flexibility needed to accommodate the parameters of the discussion treatments 

* We are assuming here that the group of N=6 rather than the individual 
student is the statistical unit of analysis. For further discussion 
of this point, see the Results Chapter. 
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Latin square designs are not frequently encountered in educational 
research though they provide very efficient tests of certain types of 
hypotheses. The term "Latin square" comes from an ancient puzzle that 
deals with the number of different ways Latin letters can be presented 
in a square (matrix) such that each letter appears once, and only once, 
in each column and in each row. 

Latin square designs are employed in experiments that meet, in 
addition to the general assumptions of the analysis of variance model, 
other conditions that include: 

- random assignment of treatment to the experimental units within each 
row and column with each treatment appearing only once in a row 

and once in a column; 

- the number of rows, columns, and treatments must be equal; 

- it is assumed that there are no interactions among rows and columns. 
To meet these conditions, each classroom used in Study I was randomly 

subdivided into four groups of six students (with the restriction that the 
number of boys and girls should be equal in each subgroup). Each of the 
four instructional treatments was assigned at random to one of the four 
subgroups within each classroom; thus, a comparison of treatments within 
each classroom was possible. Since the instructional treatments were 
carried on simultaneously within each classroom, four different ecology 
teachers were assigned to a classroom, one to each treatment subgroup. 
Teachers and classrooms were blocked into groups of four and teachers 
were assigned to treatment groups within classrooms in a Latin square 
design so that in a block of four classes each teacher taught each instruc- 
tional treatment once. In both Study I and Study II, this basic Latin 
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square was repeated three times. Thus, there were 12 classrooms per study, 
four for each of the three Latin squares and there were also 12 ecology 
teachers, four assigned to each Latin square. 

Thus, in each study three Latin squares such as that displayed in 
Table 13 were formed, 



TABLE 13 

Studies I and II 
Latin Square Design 



Classroom 


Tearher 


El 


E2 


E3 


E4 


CI 


Tl 


T2 


T3 


T4 


C2 


T2 


T3 


T4 


Tl 


C3 


T3 


T4 


Tl 


T2 


C4 


T4 


Tl 


T2 


T3 



C = Classroom 

E = Ecology Teacher 

T = Treatment 
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... \ 

Since most classrooms in the experiment had more than 24 pupils, a 
fifth treatment (Written Exercise) was provided for the remaining students. 
The data from the written exercise groups were not part of the Latin square 
design and were examined ad hoc . 

Assignment of Schools and Classrooms 

Study I was conducted in a single school district using two sixth-grade* 
classrooms from each of six schools. Characteristics of the school district 
and the students were discussed earlier in this chapter (see pages 37 to 40). 

The composition of the three Latin squares in Study I is given in 
Table 14. 

Logistic -onstraints dictated that each group of four ecology teachers 
be assigned to teach two classrooms at the same school in the morning, 
and two other classrooms at a second school in the afternoon. After 
these arrangements had been made, each Latin square was formed by pairing 
a "morning" school with the "afternoon" school geographically nearest to 
it. Table 14 reflects this arrangement by showing that each Latin square 
consists of a "morning" and an "afternoon" school. The table also shows 
the approximate time of day during which each classroom was provided 
instruction. Assignment of schools and classrooms to Latin squares was 
not random. However, the assignment procedure was not expected to 
significantly bias the learning outcomes. 

Assignment of Teachers to Latin Square Blocks 

Twelve ecology teachers were randomly assigned to the three Latin 
squares. A different group of ecology teachers taught the written 

* One classroom included both fifth and sixth-grade pupils. 
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Composition of Squares 
SQUARE 1 



ECOLOGY 
TEACHER 


SCHOOL 1 


SCHOOL 2 




Q • 9n AM*r lace 1 




1 C .our ri L 1 abb 0 




1 


Treatment 1 
B=3 
G=3 


Treatment 3 
B=3 
G=3 


Treatment 2 
B=3 
G=3 


Treatment 4 
8=2 . 
G=4 


2 


Treatment 2 
8=3 

b- J 


Treatment 4 
8=3 


Treatment 1 
B=3 


Treatment 3 
8=3 
G=3 


3 


Treatment 4 
B=3 
G=3 


Treatment 1 
B=3 
G=3 


Treatment 3 
B=3 
G=3 


Treatment 2 
8=3 
G=3 


~~ 4 


Treatment 3 
B=3 
G=3 


Treatment 2 
B=3 
G'=3 


Treatment 4 
B=2 
G=4 


Treatment 1 
8=3 
G=3 


13 


Treatment 5 
G=3 


Treatment 5 
B=4 
G=l 


Treatment 5 
B=0 
G=3 


Treatment 5 
8=0 
G=3 


SQUARE 2 


ECOLOGY 
TEACHER 


SCHOOL 3 


SCHOOL 4 




9:20AM Class 5 


10:30AM Class 6 


12:30PM Class 7 


1:30PM Class 8 


5 


Treatment 3 
B=3 
G=3 


Treatment 2 
B=3 
G=3 


Treatment 1 
B=3 
G=3 


Treatment 4 
8=3 
G=3 


6 


Treatment 4 
B=3 
G=3 


Treatment 1 

r.- ;^ 


Treatment 2 
B=3 
G=3 


Treatment 3 
8=3 
G=3 


7 


Treatment 1 
B=3 
G=3 


Treat I 4 
B=3 
G=3 


Treatment 3 
B=3 
G=3 


Treatment 2 
8=3 
G=3 


g 


Treatment 2 
B=3 
G=3 


Treatment 3 
B=3 
G=3 


Treatment 4 
B=3 
G=3 


Treatment 1 
8=3 
G=3 


15 


Treatment 5 
B=4 
G=4 


Treatment 5 
B=5 
G=5 


Treatment 5 
B=l 
G=5 


Treatment 5 
8=3 
G=2 


• 

SQUARE 3 





ECOLOGY 
TEACHER 


SCHOOL 5 


SCHOOL 6 -^^^ 




9:20AM Class 9 


10:30AM Class 10 


12:30PM Class 11 | 


1:30PM Clas§vl2 


9 


Treatment 2 
8=3 
G=3 


Treatment 3 
8=3 
G=3 


Treatment 1 
8=3 
G=3 


\ 

Treatment 4 
0 


10 


Treatment 4 
8^3 
G=3 


Treatment 1 
8=3 
G=3 


Treatment 3 
8=3 
G=3 


Treatment 2 
8=2 
G=4 


11 


Treatment 1 
8=3 
G=3 


Treatment 2 
8=3 
G=3 


Treatment 4 
8=3 
.G=3 


Treatment 3 
8=2 
G=3 


12 


Treatment 3 
8=4 
G=3 


Treatment 4 
8=4 
G=3 


Treatment 2 
8=3 
G=3 


Treatment 1 
8=3 
G=3 


14 


Treatment 5 
0 


Treatment 5 
0 


Treatment 5 
8=3 
G=2 


Treatment 5 
0 

1 



* Times are approximate 

Treatment 1 = Probing and Redirection 
Treatment 2 = No Probing and Redirection 
Treatment 3 = Filler Activity 
Treatment 4 = Art Activity I 
Treatment 5 = Written Exercise 

8 = Boys 

G= Girls 



exercise treatment. The 12 teachers were not randomly assigned to squares or 
classroom; nor were the teachers handling the written exercise treatment 
randomly assigned to classrooms. Rather these assignments depended on each 
teacher's time available for participation in the study and on logistical 
considerations. 

Assignment of Treatments to Ecology Teachers 

After the 12 ecology teachers were assigned to squares, they were 
randomly assigned to cells within the square. This assignment specified the 
order in which they taught the four treatments in the four classrooms 
during the school day. The Latin square configurations were randomly 
created so that each ecology teacher taught each treatment over the course 
of the school day, and so that each treatment was present in each classroom. 

Assignment of Students to Treatments 

Since treatment groups with an approximately equal number of boys 
and girls were judged desirable, each class was stratified with respect 
to sex of student. Boys were randomly assigned to discussion and art 
activity treatment groups until there were three boys in each group. 
The same procedure was used to assign girls to treatments. 

In a few classrooms the procedure could not be used as planned. 
For example. Classroom 12 was a combination fifth-sixth grade class 
with only 17 sixth-graders. The inadequate number of sixth graders (24 
sixth-graders were needed to form four groups of six students for the four 
treatments) created a "hole" in the Latin square design. The 17 students 
were randomly assigned to the discussion treatments only (see Table 14). 
The estimation procedures used to accommodate the missing data in the art 
activity treatment are described in the "Analysis" section of this report. 
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Because of the researchers* commitment to the school district to provide every 
student with a learning experience, fifth graders were assigned to the art 
activity treatment but were not included in the ' ata analyses. 

As shown in Table 14, two classrooms did not have sufficient numbers 
of boys or girls to create equal sex distributions in each of the treatment 
groups. In classrooms 9 and 10, the randomization procedures would have 
resulted in a single student in each group being assigned to the Written 
Exercise treatment. To prevent this awkward situation, these students 
were reassigned to the Art Activity treatment. Consequently, classrooms 
9 and 10 each had seven students in this treatment. 

The final procedure in assigning students to treatments was to check 
with the students' regular teacher to determine whether a treatment group 
contained students who were highly disruptive when placed in proximity to 
each other. Also, teachers were asked if the students assigned to the 
written activity treatment included any students whose writing skills 
would render the treatment meaningless or obviously ill-adapted to these 
students. Such students were randomly reassigned to another treatment. 
Each reassigned student was replaced by a student from that treatment in 
order to keep the design balanced. The frequency of reassignments was 
low, on the average about one per classroom. 

STATISTICAL ANALYSIS 

Adjustment Procedures 

- To insure that observed differences between treatment groups on post 
and delayed measures were not due to pre-experimental differences in 
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students' ability, students were randomly assigned to treatments within 
each classroom. To provide additional assurance that pretreatment 
differences did not contribute to posttreatment differences, each de- 
pendent variable was examined for the possibility of adjusting for 
pre-experimental differences before performing the analyses of variance. 

The decision to use adjusted post or delayed treatment scores was sub- 
ject to two conditions. Adjusted scores add little to the precision of 
analyses unless the correlation between the variable to be adjusted and the 
adjusting variable is greater than .30 (Elashoff, 1969). Hence, the first 
condition to be satisfied in using a variable to adjust a posttreatment 
measure was that its correlation with the posttreatment measure be 

greater than .30. 

The second concern in choosing adjusting variables was whether the 
usual assumptions for analysis of covariance were justified. These 

assumptions are that: 

(a) the relationship between the adjusting variable and posttreatment 
variable is linear within each lesson group (linearity), 

(b) the posttreatment scores are normally distributed about the regression 
line and their variance about the line- is a constant independent of 
the adjusting variable (normality and within group homoscedasticity) , 

(c) the regression slopes of posttreatment scores on adjusting variable 
scores are parallel for all lesson groups (homogeneity of regression). 

(d) the variance of posttreatment scores about the regression line is 
equal in all lesson groups (homoscedasticity across groups) . 

Thr, validity of' these assumptions ideally would be tested by examining 
these conditions within each group of students who experienced the experi- 
mental treatments, i.e., lesson groups. This approach was precluded since 
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there were only six students in each lesson group in both Study I and 
Study II. Therefore, in order to obtain a sufficient sample size, the 
assumptions for analysis of covariance were tested by examining the re- 
gression of individuals' posttreatment scores on individuals' scores on 
the adjusting variable by collapsing over classrooms within a single 
treatment condition. If the F-test for homogeneity of regression was 
significant at the 5 percent level or if other assumptions appeared to be 
unjustified in visual inspections of scatterplots, the posttreatment scores 
on that variable were not adjusted. Generally, these latter assumptions 
were unjustified for measures which were characterized either by a large 
number of zero scores or by a large number of maximum scores on pretreatment 
or posttreatment variables. The adjustment method employed here was in- 
tended to give a good approximation of covariance adjustment. Small size 
(N=6) precluded the use of true covariance adjustments. 

Several variables could be considered as logically valid adjusting 
variables for a given post or delay measure. In the interests of parsimony 
and ease of interpretation, the most desirable choice for an adjusting 
variable is the pretest corresponding to the posttreatment measure. For 
cases in; which the pretest variable failed to satisfy selection conditions 
at either stage, total reading score was examined as a possible adjusting 
variable. Because of the difficulty of satisfying both decision conditions 
when both pretest and total reading score were used jointly as adjusting 
variables, and because using multiple variables to adjust posttreatment 
scores was judged likely to cloud interpretations, only one variable was 
used to adjust posttreatment scores. For those variables which were ad- 
justed, the following relation was used: 
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• Y. (adj) = Y^. - bp (X^. - X), 

where: Y, (adj) is the adjusted cell mean on the posttreatment 
^ variable, 

Y^. is the unadjusted or original cell mean on the post- 
treatment variable, 

Y. is the cell mean for the corresponding adjusting variable, 

X" is the mean of all cells regardless of treatment on the ' 
adjusting variable, and 

bp is the pooled estimated of the regression slope. 

The adjusted lesson group or cell means were used in the analysis of 

variance in the same way as cell means for those variables which were 

unadjusted. Table 15 presents the information used to choose adjusting 

variables for posttreatment variables and the pooled slope estimated for 

those posttreatment variables which were acyusted. 

Unit of Analysis 

The unit of analysis chosen for both Study I and Study II was the 
discussion/lesson group; more specifically, the mean of student scores on 
any given variables within a discussion/lesson group; in other words, the 
mean of scores for the students within each cell of each Latin square pre- 
sented in Table 14. Thus, the basic data were the mean of the 12 groups 
experiencing each treatment. Within each square, each of the four treat- 
ments was assessed in four classrooms. The sample size per square, therefore, 
was the 16 cell means in that square. With three replications of each Latin 
square, the total sample size for the study would be 48 cell means. How- 
ever, the sample size for Study I was only 47 cell means due to the 
impossibility of forming four subsets of six sixth-graders from one grade- 
mixed classroom containing only 17 sixth-grade students. Procedures used to 
handle the missing data for the forty-eighth cell are discussed later in this 
section. 
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TABLE 15 
Study I 

Summary of Statistics Used in Adjusting Posttreatment Variables 



DEPENDENT 
VARIABLE 


ADJUSTING 
V'^RIABLE 


F FOR PARALLELISM 
OF REGRESSION 


r 


b 

P 


Ecology Information Test: 
Intentional Scale I, Post 
Incidental Scale I, Delay 


Total Reading 
Tota 1 Reading 


r . , - ^ . dU 
1 

1.70 
U. // 


.65 

CO 
. DC 


.09 

1 n 


Oral Test: 
Content Scale, Post 


Pre 


0.66 


.60 


.65 


Essay Test: 
Content Scale, Post 


Pre 


1 .62 


.72 


.69 


Transfer Test: 
Content Scale, Delay 


Essay Content 
Pre 


. CO 


fin 


. DO 


Written Question- 
Generating Test: 
Pertinent Questions, Post 
ijuai ity Kating, rost 


Pre 

ri c 


.93 

2 08 


:61 
.45 


.59 
.45 


Word Association Scale: 

Wolf, Post 
. All i gator. Post 
Water Pollution, Post 


Pre 
Pre 
Pre 


.60 
2.13 
1.17 


.51 
.45 
.47 


.54 
.46 
.40 


Gall -Crown Discussion 

Attitude Scale: 
Thought Questions, Post 
Discussions, Post 


Pre 
Pre 


1 .30 
.80 


.52 
.60 


.60 
.66 



Computation of Analysis of Variance 

Computations were performed using the computer program BMDX64 (Dixon, 
1973). Each of the main factors— treatment, classrooms, teachers, and 
Latin squares--was considered as a fixed effect in partitioning the total 
variance into main effects for treatments, classrooms within Latin squares, 
teachers within squares, squares, a treatment by square interaction, and a 
residual (error) term. Since the unit of analysis is the discussion/lesson 
group mean, the within group variance cannot be used to provide an error 
term. The Latin square design is not a complete factorial and only one 
classroom subgroup is used for each treatment-teacher combination. Thus, 
the residual term is a pooled estimate of between group variance composed 
of all the possible interaction terms except the estimable treatment by 
square interaction. The validity of this analysis rests on the assumption 
that the unknown interactions are negligible with respect to the identifi- 
able effects. 

Multiple Dependent Variables 

It should be noted that testing a large number of univariate hypotheses 
concerning correlated dependent variables, in this case correlated because 
the different measures were obtained from the same students, increases the 
probability of a Type I error for any single hypothesis. For example, 
in testing 20 independent hypotheses at a 5 percent level of significance, 
one statistically significant difference by chance alone might be expected. 
Since the measures in this study are correlated, patterns of all treatment, 
effects significant or all treatment effects insignificant are more likely 
than if the measures were independent. Thus, the reader is cautioned to 
view the tests of significance as signals that potentially, reliable 
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differences between treatments were observed. The interpretation of results 
win depend heavily on examining the size and patterning of differences 
among treatments as well as considering whether treatment differences are 
consistent within conceptually meaningful clusters of dependent variables. 

A formal method of combining results across dependent variables and 
maintaining a fixed significance level for the combined analysis would be 
to use a multivariate analysis of variance. However, multivariate pro- 
cedures were not used in this study because of the small number of degrees 
of freedom for error, the decreasing robustness of analysis of variance as 
dependent variables are added, and the increased difficulty in making 
interpretations of the results. 

Missing Data 

Two types of "missing" data are present in this analysis—unequal 
class sizes and the empty cell previously discussed. Unequal classes were 
simply ignored in this analysis. The missing cell mean was estimated by 
a full least squares solution where each effect was treated as entering 
last. Treatment means were calculated from the estimated treatment effects. 
They are not the simple means. 

Omega Squares 

Omega squares (Hays, 1965; Glass & Hakstian, 1969) were calculated. 
These statistics provide an estimate of the strength of association 
between variables (as a percent of variance) and may be helpfyl in the 
interpretation of results. Omega squared is very dependent on exact 
design and .the treatments included. 
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Planned Comparisons 

In addition to examining the data for overall treatment differences, 
several questions pertaining to differences between treatment groups were 
of interest. Specifically, in Study I the following planned comparisons 
of treatment differences were examined on all deoendent variahlps: 

(a) probing and redirection versus no probing and redirection, 

(b) no probing and redirection versus filler activity, and 

(c) the recitation treatments as a whole (probing and redirection, 
no probing and redirection, and filler activity) versus art 
activity. 

Each planned comparison had one degree of freedom and was tested for 
significance using the mean square error term from the analysis of variance. 
For those dependent variables which were adjusted, the comparisons used 
adjusted cell means. 

Summary 

The results reported in the following chapter are based upon a Latin 
square design, Adjustments for pre-existing differences in cell means 
were made using estimated analysis of covariance adjustments where reason- 
able. Missing data were estimated by a full least squares solution. 
Several planned comparisons as well as main effects were tested. Computatic 
were performed using computer program BMDX64. 
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CHAPTER FOUR 
STUDY I RESULTS 



The statistical analyses for Study I were planned in response to 
three research objectives: 

1. to determine what student learning outcomes are affected by, 
presence or absence of probing and redirection in discussions; 

2. to determine what student learning outcomes are affected by 
presence or absence of discussions; and 

3. to determine the relative effect on student learning of 
teachers' questions delivered in discussions compared with 
the same questions presented and answered in written format. 

Five instructional treatments were designed to investigate these effects. 
These included three discussion treatments, an art activity treatment, and 
a written exercise treatment. In the probing and redirection discussion 
treatment, twelve groups of students participated in discussions in which 
their ecology teacher probed and redirected the students* answers to pre- 
specified questions. In the no probing and redirection discussion treatment, 
twelve groups of students participated in discussions in which the same pre- 
specified questions were asked, but none of the students' answers were probed 
or redirected. The filler activity 'discussion treatment was identifical in 
format to the no probing and redirection treatment except that a filler 
activity was added after each discussion to equate it in length to the prob- 
ing and redirection treatment. Twelve groups of students also participated 
in the filler activity treatment. In the art activity treatment, eleven 
groups of students participated in curriculum-related art activities with no 
discussion. Finally, in the written exercise treatment, nine groups of 
students responded to the same prespecified questions as in the discussion 
treatments, except that the questions were presented and answered in written 
format.. 
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The treatments were administered within a Latin square design by fifteen 
ecology teachers* to twelve sixth-grade classes in a single school district. 
Each student was administered a test battery before, immediately after, 
and/or two weeks after the treatments to determine the effects of the 
treatments on achievement and attitudes related to the specific curriculum 
which they had studied. 

In the following section the data for each test variable are examined 
by analysis of variance methods to test statistical significance of the 
overall treatment effect. The treatment group (usually six students) 
rather than the indtvidual student was used as the unit of analysis. 

Following the analysis of variance for treatment main effects, 
planned comparisons of treatment means for each dependent variable are 
presented. The purpose of these comparisons is to determine the statistical 
significance of the following differences: 

1. The difference between the probing and redirection treatment 
mean and the no probing and redirection treatment mean for 
each outcome variable. This analysis is designed to. determine 
whether certain outcome variables are affected by the presence 
of probing and redirection techniques in discussion. 

2. The difference between the no probing and redirection treatment 
mean and the filler aqtivity mean on each outcome variable. 
This analysis is designed to determine whether observed 
differences on outcome variables between the probing and re- 
direction treatment and the no probing and redirection treatment, 
if any, can be explained by the treatment differences in time 

on task. 

3. The difference between .the three combined discussion treatment 
means and the art activity mean on each outcome variable. The 
purpose of this analysis is to determine whether certain outcome 
variables are affected by opportunity to participate in discussion 
following initial reading/viewing of curriculum material. 



* Twelve of the ecology teachers administered each of the discussion 
treatments and the art activity treatment. The three remaining teachers 
administered the written exercise treatment. 
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The final planned comparison involves the difference between the written 
exercise treatment mean and each of the other treatment means for each of 
the outcome variables. The analysis of variance design used here does not 
permit the usual tests of statistical significance of differences in this 
particular instance. Instead, each of the discussion and art activity means 
are examined to determine whether they fall above or below the 95 percent 
confidence limits for the corresponding written exercise treatment mean. 

A discussion of other effects examined by the analysis of variance 
follows the planned comparisons. These include class, ecology teacher, 
and Latin square effects, and treatment by Latin square interactions. 

For ease of interpretation the results are organized into three main 
sections. First, the-achievement test data are discussed in terms of 
(1) treatment main effects, (2) planned comparisons of treatment means, 
and (3) other analysis of variance effects. Next, the analyses of attitude 
scale data are discussed under the same headings. Finally, the status 
variables of verbal ability and session attendance are discussed in the 
context of their possible influence on treatment differences. 

Cell means used in the analyses are reported in Appendix D of this volume 

ACHIEVEMENT MEASURES 

Table 16 presents the results of the analysis of variance for the 
ability, achievement, and attendance measures. A relatively detailed 
description of this table is presented below to insure that all infor- 
mation of value can be easily obtained from it. 

The leftmost column lists the names of the dependent variables. Each 
row of the table corresponding to the variable named presents information 
pertaining to that variable only. 
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Analysis of Variance Sumry for 
Measures of Ability, Achievement, and Attondance 



OtPEflDENT VARIABLE 



SWUS VARIABLE 
llSgi: of Ses sions At tended 



CJB F, Total ReadTnq 



ADJUSTING 
VARIABLE 



■MS error 
df=17 



0.55 



F VALUES AND FOR ANALYSIS OF VARIANCE EFFECTS 



Treatment 



F3,17 



1.74 0.06' 



Class 



F9,17 



Teacher 



0.48 0.12- 



Fg, 17 ii'^ 



Square 



F2,17 



D.68 0.07 



0.56 0.02 



Treatment 
by Square 



F6,17 



0.88 0.13 



KNOlliDrWBlEr 
Ecology Information Test: 
Inte ntional Scale I, post [ total rdng 



61.14 



2.31 0.06 



1.82 0.12 



0.93 0.01 



3.36 0.07 



1.13 0.01 



0.85 



5.04* 0.20 



2.53* 0.22 



0.46 0.00 



0.35 0.00 



0.26 0.00 



Intentional Scale I, delay 



incidental Sca'ie I, post 



1.12 



6.90* 0.19 



3.19* 0.21 



1.09 0.01 



2.44 0.03 



1.73 0.05 



"BT 



3.07 0.12 



1.61 0.10 



1.20 0.03 



0.87 0.21 



jncjd ental Scale I, delay 



ffliRliiltlVE VARIABLES 
Oral Test: 
jontent, posj 



.total rdng 



2.46 



1.06 0.00 



2.38 0.25 



0.21 0.00 



0.61 0.00 



0.69 0.00 



Hggical Extension, post 
^ssayTesF 
_Jontent^jos^ 



pre 



6.83* 0.30 



0.64 0.00 



0.94 0.00 



0.62 0.00 



0.74 0.00 



1.49 



3.05 0.10 



1.55 0.08 



1.27 0.04 



2.12 0.04 



0.75 0.00 



pre 



1.92 



3.13 0. 



3.24* 0.22 



0.37 0.03 



2.10 0.16 



0.53 0.03 



Logical Extension, post 



0.28 



5.37* 0.13 



5.67* 0.41 



I'ransfer Test: 
jgntent, dejajf 



essay pre 



1.71 



3.42* 0.07 



3.27* 0.32 



0.75 0.00 



0.16 0.00 



1.58 0.03 



L28 0.00 



8.79* 0.10 



1.43 0.( 



■ Jgicalixrension, delay 



QuestIon:generAting variables 

Written Question Generating Test 
Jlon^ pertinent Questions 



0.26 



3.05 0.05 



5.55* 0.35 



1.41 0.03 



11.58* 0.18 



0.93 0.00 



H^tinent Question"? 



0.12 



5.12* 0.09 



7.80* 0.42 



1.69 0.04 



9.65* 0.12 



1.21 0.01 



WW 



pre 



1.05 0.00 



5.62* 0.43 



IWIM 



■^ Sgecific Questions 



8.69 



3.17 0.06 



3.62* 0.22 



2.48 0.13 



2.93* 0.07 



2.98* 0.11 



Request for Rationale 



0.13 



2.05 0.08 30.05* 0.02 



5.32* 0.04 



9.80* 0.31 



6.99* 0.18 



OraniipcHnn Gene 



pre 



3.23* 0.07 



4.61* 0.32 



0.60 0.00 



6.09* 0.10 



2.47* 0.00 



Question Generating Test: 
■_ J!on-pertinent Questions 



3.38* 0.16 



0.47 0.10 



1.11 0.02 



0.77 0.00 



0.33 0.00 



Pertinent Questions 



0.35 



1.45 0.03 



1.59 o.n 



1.14 0.03 



0.58 0.02 



0.40 0.07 



0.10 



2.13 0.07 1.54 0.11 



0.78 0.00 [ 0.82 0.00 



0.77 0.00 



*Significance at the .05 level. The .05 levels for F values with the following degrees of freedom are: 
F;, 17=4.45 F2, 17=3.59 F3, 17=3.20 Fb,i7=2.70 F9,i7=2.49 

= proportion of total variance explained (omega squared). The missing cell in the Latin square design 
was estimated to compute the total sum of squares. 



125 



£l^(^-bCTBS=Comprehensive Tests of Basic Skills 



If the dependent variable was adjusted before the data were analyzed, 
^ the namo of the adjusting variable appears in the column labeled "Adjust- 
ing Var iable.'' The majority of the adjusting variables are the pretreatment 
measures corresponding to the dependent variable, signified as "pre." 
Otherwise total reading score was generally used as the adjusting variable. 
The only exception to this rule was the Transfer Test. Since this measure 
had no corresponding pretreatment test, the pretreatment Essay subscale 
scores were used to adjust the parallel Transfer Test subscales. When no 
variable is listed in the column, no adjustment was made in the particular 
posttest score. 

The column labeled "MS error" presents the error mean square from the 
analysis of variance of cell means or adjusted cell means and its degrees 
of freedom for each dependent variable. 

The next five columns list the F-statistics computed for the main 
effect of treatment, of class within squares, of teachers within squares, 
of squares, and the treatment by square interaction, respectively. Also 
noted are the degrees of freedom associated with each effect. The critical 
values of the F-statistic at the 5 percent level of significance are 
presented in the footnote. F-statistics for dependent variables which 
are greater than the critical value are starred within the column to note 
statistical significance. The columns also show the omega squared (strength 
of association) statistics associated with each treatment effect. This 
statistic is interpreted as the percentage of variance in the dependent 
variable attributable to the treatment effect for that column. It should 
be noted that the total sum of squares term used in calculating values 
for Study I was found by summing the sums of squares for each effect. 
Thus, the estimated cell mean (see previous discussion of Latin square) 
is included in these calculations. 
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Main Effect of Treatment 

Inspection of Table 16 shows that there were statistically significant 
differences at the 5 percent level between instructional treatment group 
means on seven achievement variables: 

- Ecology Information Test Intentional Subscale I (post and delayed), 

- Oral Test Content (post), 

- Essay Test Logical Extension (post), 

- Transfer Test Content (delayed), 

- Written Question-Generating Test Non-Pertinent Questions (post), 

- Written Question Generating Test <Juanty Rating (post), and 

- Oral Question Generating Test Non-Pertinent Questions (post). 

In a total of 18 independent significance tests made at the 5 percent level, 
about one significant result would be expected by chance. Therefore, it 
is likely that one of these significant differences occurred by chance. 
Cell means used in the analysis are reported in Appendix D. 

It is interesting to note that treatment effects concentrated in the 
student outcome areas that represent more difficult levels of performance. 
Only one area of fact recall showed an effect and even this was in terms 
of retention of knowledge, a more difficult outcome than immediate recall 
of facts. The other measures^to show effects were in higher cognitive 
performance and students* ability to generate questions such as those asked 
by the teacher during the discussions and/or in the written exercise. 

Planned comparisons to determine which of the treatment means differed 
significantly from each other on these achievement variables are presented 
in the next section. 

The percentage of variance attributable to tv-eatment effect is reflected 
in the omega squared values. Especially noteworthy are the values for the' 
Content subscale of the Oral Test and the Ecology Information Test Intentional 
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Subscale post and delayed. For the Content subscale the value was .30 
suggesting treatment conditions had considerable influence on variance in 
students' performance on this measure. The omega squared values for the 
Ecology Information Test Intentional Subscale were .20 post and .19 delayed. 
This suggests that the measures were sensitive to the degree to which 
students acquired factual information as a result of various treatment 
conditions. In general, however, the effect of treatment on the types of 
achievement measures obtained in Study I was small in absolute value with 
the median of the omega-squared values equal to .08. 

Planned Comparisons (Treatments) . 

Table 17 reports the results of the planned comparisons of the achieve- 
ment measures. It lists each of the status and achievement test variables 
in the first column. The next four columns present cell means for each 
treatment in the Latin square design: probing and redirection, no probing 
and redirection, filler activity, and art activity, respectively. For 
those variables which were adjusted before entry into the analysis of 
variance, these values are adjusted cell means. The means for the art 
activity were calculated by including the estimated cell mean for the 
missing treatment group. A reference number (in parentheses) associated 
with each treatment is used in labeling the columns for planned comparisons. 

The unadjusted cell means and 95 percent confidence limits for the 
written exercise treatment are presented in the next two columns. These 
results will be discussed later in this section. 

The next three columns present F-statistics for the planned comparisons 
of treatment group means or adjusted means. The first of jthese columns 
compares probing and redirection with no probing and redirection (1 vs. 2); 
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study 1 

Treatment Means and Planned Comparisons of 
Measures of Ability, Achievement, and Attendance 



DEPENDENT VARIABLE 


An iiirTTM/^ 

ADJUSTING 
VARIABLE 


TREATMENT MEANS 


PLANNED COMPARISONS 


rrODc 

9 Do 

a re- 
direct 


m rrooe 

9 Da/4 

direct 


rii ler 
Activ. 


nrl 

Hcnv. 


writ. 
Exer. 


50/3 Liiinis 

^AM Tv^A^ ^ 

Tor ireai- 

ment 5 


iredt- iredt- 
ments oients 
1 vs2i2vs3 


ireat" 
ments 
1,2,3 V5 4 


(1) ■ 


(2) 


13) 


(4) 


(5) 




Fl,17 F1J7 


■■ ■Fi,i7 Prop. 


STATUS' VARIABLES 

Number of Sessions Attended 




9.03 


A or 

9.35 


A TA 

8.78 


9.40 


A AH 

9.23 


A A'l A rA 

8.8'J- 9.62 


i.ir; 3.45 


1.73 0.33^ 


ITI3> - Total Reading 




f*ft nn 

58.89 


54.42 


r A m 

53.81 


rA 1 r 

50.16 


57.45 


^ M ft* 1AA AT 

14.6b-100.2E 


1.96 


0.04 ■ 3.89 0.56 


i/Mftt.ii cnrr \/AnTADi rc 

Ecology intomiation Test: 
Intentional Scale I, post 


total rdng 


5.79 


6.00 


6.16 


4.73 


6,20 


5.61-' 6.80 


0.30 


0.18 


14.16* 0.94 


Intentional Scale I, delay 




5.69 


r 1 A 

5.13 


5.73 


3.89 


5.15 


4.37" 5.93 


1.71 


1.97 


18.25* 0.88 


Incidental Scale I, post 




7.69 


7.83 


7.02 


5.96 


7.83 


6.07- 9.59 


0.04 


1.56 


7.41* 0.81 


Incicental Scale I, delay 


total rdng 


7.00 


6.89 


6.40 


5.93 


7.G8 


5.36- 8.80 


0.03 


0.60 


2.90 0.69 


HIGHER COGNITIVE VARIABLES 
Oral Test: 
Content, post 


pre 


8.41 


8.14 


7.47 


6.55 


7.62; 


6.86- 8.38 


0.40 


2.54 


15.24* 0.74 


Logical Extension, post 




2.59 


3.33 


2.92 


2.09 


2.79 


1.75- 3.83 


0.28 


0.64 


7.35* 0.80 


Essay Test: 
Content, post 


pre 


10.72 


10.58 


9.86 


9.09 


9.79 


3.45''1].13 


0.06 


1.62 


6.72* 0.54 


Logical Extension, post 




1.79 


1.58 


1.40 


0.91 


1.46 


1.26-1.66 


1.02 


0.66 


12.78* 0.79 


Transfer Test: 
Content, delay 


essay pre 


8.15 


A An 

8.09 


6.85 


6.93 


/* A A 

6.80 


5.60- 8.00 


0.01 


5.39* 


2.67 0,26 


Logical Extension, delay 




T56 


1.55 


1.39 


0.97 


^ /I A 

1.42 


1.24. 1.50 


0.00' 


■ 0.60' 


8.33* 0.93 


QUESTION-GENERATING VARIABLES 
Written Question Generating T« 
Non-pertinent Questions 


St; 


0.52 


0.52 


0.41 


0.95 


0.55 


0.48- 0.64 


0.00 


0.65 


14.52* 0.93 


Pertinent Questions 




pre 


12.41 


10.97 


11.94 


11.38 


13.33, 


-17.95-44.61 


2.79 


1.25" 


0.27 0.08 


Specific Questions 




3.30 


2.96 


3.05 


2.12 


3.87 


-2.21- 9.95 


0.79 


0.05 


8.54* 0.91 


Request for Rationale 




0.78 


A n 

0.57 


A ri 

0.51 


A AP 

0.25 


A T A 

0.70 


An A TA 

0.61- C,79 


1.79 


0.16 


7.50* 0.69 


Quality Rating 




pre 


3.04 


3.08 


2.86 


2.79 


3.08 


2.60- 3.56 


0.19 


4.43 


4.76* 0.49 


Oral Question Generating Test: 
Non-pertinent Questions 




0.33 


0.10 


0.10 


0.03 


0.56 


0.52- 0.60 


5.55* 


0.00 


2.90 0.72 


Pertinent Questions 




1.36 


1.82 


1.64 


1.43 


1.65 


1.4M.90 


3.57 


0.55 


0,71 0.16 


Quality Rating 




0.80 


1.00 


0.96 


1.14 


' 0.95 


0.88-1.02 


2.37 


0.11 


3.75 0.58 
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* Significance at the .05 level. The .05 levels for F values with the following degrees of freedom are: 
Fi,i7:4.45 F2, 17=3.59 F3,i7=3,20 F6,i7=2.70 F9,17=2.49 

^ lleans for Art Activity Treatment I differ from the actual means because the missing cell value was estimated in 
the analysis of variance. 

^^^:op. = Sum of squares for Treatments 1,2,3 vs. 4 as a proportion of total treatment sum of squares. 
rf*TTBS = Comprehensive Tests of Basic, Skills, •■ 
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the second contrasts no probing and redirection with filler activity 
(2 vs. 3). The next column compares the average effect of the three 
recitation treatments with the non-recitation art activity treatment. 
Each of these planned comparisons has one degree of freedom and was tested 
using the error mean square from the analysis of variance. The critical 
value of the F-statistic for 1 and 17 degrees of freedom at the 5 percent 
level of significance is provided. F-statistics which are statistically 
significant at the 5 percent level are starred. In the column labeled 
"Prop," the ratio of sum of squares for the contrast to sum of squares for 
the main effect of treatments is presented. This is a measure of the 
proportion of variability among the four treatments accounted for by the 
difference between the mean of the discussion treatments and the non- 
discussion treatment. In other words, this ratio indexes the degree to 
which discussion was the contributing factor in the main effect for treat- 
ments. 

The planned comparisons of treatment differences indicate that there 
was little difference in the effects of the discussion treatments of 
probing and redirection, no probing and redirection, and filler activity 
on achievement test variables. Exceptions to this generalization are 
that the probing and redirection treatment groups generated significantly 
more oral non-pertinent questions than the no probing and redirection 
groups; and the no probing and redirection groups achieved a reliably 
greater transfer test content score than did the filler activity. Because 
of the substantial number of comparisons involved in this analysis, it is 
quite possible that these two significant differences are a chance finding. 

These results relate to one of the research objectives of Study I: 
to determine what student learning objectives are affected by presence 
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or absence of probing and redirection in discussion. The results indi- 
ca te that teacher use of probing and redirection techniques in discussion 
doe s not facilitate knowledge acquisition, higher cognitive response 
ability, or question-generating ability . Possible explanations of this 
lack of effect of the skills within the discussion treatments will be 
presented in Chapter Seven. They will be considered in view of the find- 
ings of Study II as well as the results reported here. 

It is important to note that these findings also suggest that time 
in discussion may be of limited importance. Inasmuch as the filler activity 
treatment controlled for time in discussion without use of probing and 
redirection, the failure to identify significant differences between the 
no probing and redirection treatment and the filler and the probing and 
redirection treatments indicates approximately ten minutes of additional 
time provided by these latter two treatments had limited effect. 

On the other hand, the comparison of the average of the three recita- 
tion treatments versus art activity reveals that discussion in and of 
itself promotes statistically significant improvements (p<.05) in achieve- 
ment on the following measures: 

- Ecology Information Test Intentional Subscale I (post and delayed), 

- Ecology Information Test Incidental Subscale I (post), 

- Oral Test Content (post) and Logical Extension (post), 

- Essay Test Content (post) and Logical Extension (post), 

- Transfer Test Logical Extension (post), 

- Written Question-Generating Test, Non-pertinent Question (post), 

- Written Question-Generating Test, Specific Questions, 

- Writtexi Question-Generating Test, Request for Rationale, and 

- Written Question-Generating Test, Quality Rating. 
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The proportion of total between treatment variability accounted for by 
the comparison of discussion treatments with the art activity was sub- 
stantial, ranging from .08 to .94 with 12 of the 18 comparisons having 
a ratio greater than or equal to .65. 

These results relate to the research objective of Study I concerning 
which student learning objectives are affected by presence or absence of 
discussions. They indicate that discussion of the type incorporated in 
the three discussion treatments is more effective than a competing no 
discussion treatment in facilitating knowledge acquisition, ability to 
respond to higher cognitive questions both orally and in written form, 
and ability to generate questions. 

It therefore appears that the overall strategy of discussion is an 
important means for building both students* fact recall and higher cognitive 
skills. Because the discussions included in Study I were carefully planned 
and presented, based on the semi -programmed format given to the teachers, 
it is difficult to determine whether this strong effect should be attributed 
to discussion per se. However, it seems necessary to assume that the find- 
ings should be limited to only those te?^cher-directed discussions that are 
planned and structured similarly to those used in the study. 

The unadjusted cell means for the written exercise treatment are 
presented in column 8 of Table 17. The next column, labeled "95% Limits 
for Treatment 5," presents a '^confidence" interval about each writte.. 
exercise treatment mean. The mean square error term from the analysis 
of variance was used in calculating these limits. To the extent that 
the written exercise treatment is comparable to the other treatment means, 
this term is the best estimate of betwepn-group variability. The formula 
for this confidence band 
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_ MS error _ MS error 

Y= (2J1) y;;- i My i Y + (2, 11) , 

where: Y = written exercise treatment mean, 

MS error = mean square error term from column 3, and 

n = number of cell means used in calculating Y 

To the extent that other treatment means lie within this confidence band, 
the written exercise treatment probably can be judged approximatel-y as 
effective as those other treatments,* 

Applying this procedure to the achievement measures, the written 
exercise treatment appears to promote more learning relative to the art 
activity treatment on a variety of post dependent variables: 

- the Intentional Scale (post and delayed) and Incidental Scale (post) 
of the Information Test 

- the Content Scale of the Oral Test (post) 

- the Logical Extension Scale of the Essay (post) and Transfer Tests 
(delayed) and 

- the Request for Rationale Scale (post) of the Written Question- 
Generating Test, 

In contrast, the art activity treatment exceeded the 95 percent limit on 
a single scale: the quality rating scale (post) of the Oral Question- 
Generating Test, 

Several differences between the written exercise treatment and the 
probing and redirection treatment can be identified. The probing and 
redirection means for the higher cognitive response variables fell slightly 
above the 95 percent limits on the Content Scale (post) of the Oral Test, 

* For those analyses in which the dependent variable was residualized, 
the limits were calculated about an unresidual ized written exercise 
treatment mean using the residualized mean square error. Thus, the 
"te5;ts" for reli^Me differences bet»veen the written exercise treatment 
and other treatment means probably are liberal, 
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the Content Scale (delayed) of the Transfer Test, and the Logical Extension 
Scale (post) of the Essay Test. The probing and redirection means fell 
below the 95 percent limits on quality and frequency of pertinent questions 
on the Oral Question-Generating Test (post), 

A few treatment means for the other discussion treatments also fell 
above or below the 95 percent limits of the corresponding written exercise 
treatment means, but they do not define a meaningful pattern. 

These findings relate to the third objective of Study I, which was to 
determine the relative effect on student learning of teachers' questions 
delivered in discussions compared with the same questions presented and 
answered in written format. It appears that questions in written format 
are generally as effective as questions in discussions in promoting know- 
ledge acquisition and question-generating ability. However, written questions 
are not as effective as discussion questions which are probed and redirected 
in promoting hig her cog nitive response ability. Finally, questions in 
written format appear to be more effective than a competing instructional 
method (art activity) in promoting some learning outcomes related to know- 
ledge acquisition, higher cognitive response ability, and question-generating 
abil ity . 

Classroom, Teacher, and Square Effects 

Classroom Effects . The analysis of variance confirmed prior expecta- 
tions in revealing significant differences among classrooms on the majority 
of achievement measures. These included: Ecology information Test Intentional 
Subscale I (post and delayed), Essay Test Content (post) and Logical Extension 
scales (post). Transfer Test Content (delayed) and Logical Extension scales 
(delayed), and all five of the measures derived from the Written Question- 
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Generating Test. The omega squared values were generally large for the 
effect of classroom, ranging from .00 to .43 with a median of .22. It 
is interesting to note that the oral measures of achievement showed no 
significant classroom effects and generally had the lowest omega squared 
values. Since these variables were most directly related to the conditions 
of the discussion treatments rather general classroom conditions, this 
finding lends credence to the use of such measures in the study and 
suggests that they may be the most important estimates of treatment 
effect. 

Teacher Effects . In only one case, the Request for Rationale Scale 
of the Written Question-Generating Test, was there a significant main 
effect found for ecology teachers. The omega squared values range from 
.00 to .13, with a median of .01. Thus, it may be assumed that differences 
in achievement measures are not attributable to variation among the ecology 
teachers. Given the findings reported in the fidelity of treatment section, 
this lack of teacher effect is particularly important. Although one ecology 
teacher failed to maintain the desired time limits, this and other non- 
reported differences among teachers did not affect treatment outcomes. 

The implications of this finding, particularly as it relates to the 
use of the semi -programmed approach to discussion, will be discussed in 
Chapter Seven. For the Rnost part questioas are raised relative to whether 
use of such an approach reduces the impact of other teacher characteristics 
such that the effects of the particular teaching strategies to be studied, 
in this instance probing and redirection, will become more pronounced or 
whether it controls so many aspects of the learning- situation that the 
effects are, in fact, masked and/or of secondary importance. 
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Square Effects . The analysis of variance for squares showed statisti- 
cally significant differences only in the case of the two transfer test 
measures and the measures obtained from the Written Question-Generating 
Test. The omega squared values for the square effect over all the dependent 
achievement variables ranged from .00 to .31 with a median of .02. 

While square effects were minimal, the square effect for total read- 
ing score approached statistical significance (see Table 16). Based upon 
this finding, the hypothesis was formulated that the square effects that 
were identified for dependent variables could reflect pre-existing 
differences in reading ability. This hypothesis was tested first by 
computirvg the mean of the total reading scores for the set of treatment 
groups within each Study I Latin square. The result of this analysis is 
shown in Table 18. It .is apparent that the total reading score mean for 
Square 1 is substantially higher than the other two square means, which 
are quite similar in magnitude. If the significant square effects 
observed in Table 16 reflect these pre-existing differences in readinn 
score, the mean for Squarfe 1 should be grec^ter than the other two square 
means for each dependent variable for which a significant square effect 
was identified. Table 18 includes the square means for the transfer test 
and written question-generating test variables. In each instance. 
Square 1 has the highest mean. Further, the difference between the 
Square 1 mean and the other two square means generally is greater than 
the difference between the means of Square 2 and Square 3. Thus, a 
plausible explanation of the observed square effect is that by chance 
the classes assigned to Square 1 were of higher initial ability than the 
classes assigned to the other two squares. 
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TABLE 18 



Study I 

Latin Square Means for 
Variables Exhibiting Square Effect 



VARIABLE 



Comprehensive Test of Basic Skills, 
Total Reading Score 

Ti^ansfer Test, Content Scale 

Ti^ansfer Test, Logical Extension 

Written Question-Generating Test, 
Non-Pertinent Questions 

Written Question-Generating Test, 
Pertinent Questions 

Written Question-Generating Test, 
Specific Questions 

Written Question-Generating Test, 
Requests for ^Rationale 

Written Question-Generating Test 
Quality Ratir)g 

Ecology Unit Ojsinions, 

''Attitude toward Ecology Curriculum 



SQUARE 1 SQUARE 2 SQUARE 3 

X X X 

58.62 52.72 52.19 

8.82 6.36 7.22 

1.75 0.91 1.45 

.73 .30 .52 

13.57 10.08 11.20 

3.28 2.49 2,84 

1.04 .15 .55; 

2.92 2.64 2.53 

31.76 29.43 29.61 
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While this finding is of some concern, the inclusion of all discussion 
treatments in each square and the adjustment of post and/or delayed 
measures for entering ability lessens the extent to which the proposed 
square effects must be considered in interpreting treatment outcomes. 

Square by Treatment Interactions, There were three dependent variables 
for which there was a statistically significant effect of square by treatment 
interaction, namely, the Written Question-Generating Test measures of 
Specificity, Request for Rationale, and Quality Rating. 

ATTITUDE MEASURES 

Table 19 presents the results of the analysis of variance for scales 
derived from the following attitude measures: Word Association Scale, 
Gall-Crown Discussion Attitude Scale, Ecology Unit Opinions Scale, and 
Ecology Discussion Attitude Scale.* The Written Exercise Attitude Scale 
and Ecology Art Project Scale were not included in this analysis since 
these scales were administered only to students in the treatment for 
which they were designed (written exercise treatment and art activity I 
treatment, respectively). 

Table 19 is organized according to the same format as Table 16. 
The leftmost column lists the names of the dependent variables. Whenever 
the dependent variable was adjusted before the data were analyzed, the 
name of the adjusting variable appears in the column labeled "Adjusting 
Variable." The column labeled "MS error" presents the error mean square 
from the analysis of variance for all means or all adjusted means. The 

* Analysis of variance for the two subscales derived from the Ecology 
Discussion Attitude Scale included only the three discussion treatments. ^ 
This measure was not adr^tinistered to students in the Art Activity and 
Written Exercise treatments since they did not participate in ecology 
^ discussions. 
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ME 19 
Study I 

/ 

\ 

Analysis ol Variance of Attitude Scale Scores 



DEPENDENT VARIABLE 


ADJUSTING 
VARIABLE 


MS 

error 

mi 


F VALUES AND FOR ANALYSIS OF VARIANCE EFFECTS 


Treatment 


Class 


Teacher 


Square 


Treatment 
by Square 


F3,17 




Fq,i7 




F6,17 


CURRICULUM -RELATED VARIABLES 
Word Association Scale: 
Balance of Nature 




17.67 


0.92 0.00^ 


2.11 0.17 

Vlli 


2.33 0.20 


1.93 0.03 


1.90 0.09 


Ecoloqy 




21.16 


1.15 0.01 


2.12 0.25 


1.47 0.11 


0.11 0.00 


0.48 0.00 


Wolf 


pre 


32.55 


1.30 0.02 


0.92 0.00 


0.87 0.00 


0.10 0.00 


1.07 0.00 


Air Pollution 




10.59 


1.14 0.00 


1.44 0.09 

1 • 1 1 V • V 


0.45 0.00 


0.14 0.00 


0.93 0.00 


Alligator 


pre 


27.90' 


2.24 0.07 


1.20 0.03 


0.88 0.00 


0.28 0.00 


1.42 0.04 


Water Pollution 


pre 


9.58 


1.14 0.00 

1 • 1 1 W 1 WW 


0.88 0.00 

W I w w • w w 


0.59 0.00 


0.15 0.00 


■ 1.06 0.00 


DISCUSSION VARIABLES 
Gall -Crown Discus. Attitude Sc 
Alt. toward Thought (|ues. 


ale: 
pre 


7.96 


0.25 0.00 


1.71 0.15 


0.55 0.00 


0.52 0.00 


0.37 0.00 • 


Attitude toward Discussion 


pre 


8.39 


1.32 0.01 


5.38* 0.33 


2.44 0.13 


0.56 0.00 


1.16 0.01 


GENERAL TREATMENT VARIABLES 
Ecology Unit Opinions Scale: 
Attitude toward Peers 




3.46 


0.16 0.00 


1.56 0.08 


2.43 0.20 


0.50 0.00 


1.05 0.00 


Attitude toward Teacher 




10.74 


1.53 0.02 


3.80* 0.32 


1.97 0.11 


0.91 0.00 


0.36 0.00 


Attitude toward Curriculum 




4.32 


1.64 0.02 


4.06^ 0.29 


1.87 0.08 


6.18* 0.11 


0.81 0.00 


TREATMENT-SPECIFIC VARIABLES 
Ecology Discussion Attitude Sc 
Att. toward Thought Ques. 


ale: 


3.83 


2.10 0.01 


4.10* 0.31 


2.67* 0.16 


1.41 0.00 


0.74 0.00 


Attitude toward Discussion 


GDAS-Disc 
pre 


4.54 


3.64* 0.03 


3.08* 0.16 


6.12* 0.41 


0.71 0.00 


0.40 0.00 



* Significance at the .05 level . The .05 levels for F values with the following degrees of freedom are: ^ . 

140 F^i^=4.45 F2, 17=3.59 F3,i7=3.20 F6,i7=2.70 F9,i7=2.49 a3J 

^(1)2 = proportion of total variance explained (omega squared). The missing cell in the Latin square design was 
estimated to compute the total sum of squares. 
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next five columns list the F-statistics and strength of association 
statistics (omega squared) for the main effect of treatment, of class 
within squares, of teachers within squares, of squares, and the treatment 
by square interaction respectively.. Cell means on which the analysis was 
based for each variable are reported in Appendix D. 

Main Effect of Treatment 

Table 19 indicates that overall the treatment effect was statistically 
significant only for the Attitude toward Discussion subscale of the Ecology 
Discussion Attitude Scale (p<.05). Omega squared values were consistently 
small with only one exceeding .05. Further, perusal of cell means for the 
various attitude measures (see Appendix D, Tables D-20 through D-34) indicates 
that students generally were highly positive about the various treatment 
conditions. This, in turn, raises questions regarding the possible 
occurrence of a Hawthorne effect which may have been maintained over the 
nine day treatment period. 

Planned Comparisons 

Planned comparisons involving the differential effects of treatments 
on attitude scales are presented in Table 20. This table is organized 
according to the same format as Table 17, which presents the planned 
comparisons involving the achievement variables of Study I. To 
restate the format, the attitude scales are listed in the first column; 
the next four columns present adjusted or unadjusted cell means for the 
discussion treatments and the art activity; the unadjusted cell means 
and 95 percent confidence limits for the written exercise treatment 
are presented in the next two columns; the next three columns present 
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study I 



Treatment Means and Planned Comparisons of Attitude Measures 



DEPENDENT VARIABLE 


ADJUSTING 
VARIABLE 


TREATMENT MEANS 


1 

PLANNED COMPARISONS 


Probe 
& Re- 
direct 


' No Prb 
He- 
direct 


Filler 
Activ. 


Art 
Activ. 
I 


Writ. 
Exer. 


95% Limits 
for Treat- 
ment 5 


Treat-, 
ments 
1 vs2 


Treat- 
ments 
2vs3 


Treat- 
ments 

1,2,3 vs4 


01, 


(2) 




w 


(5) 




Fl,17 


Fl,17 


F;,:7 Prop. 


CURRICULUM-RELATED VARIABLES 
Word Association Scale: 
Balance of Nature 




55.62 


57.61 


57.66 


! 

! 55.52b 


54.35 


39.54-69.16 


1.35 


0.00 


0.91 0.33*^ 


Ecology 




58.41 


61.38 


61.13 i 61.34 


60.48 


48.11-72.85 


2.50 


0.02 


0.40 0.11 


Wolf 


pre 


47.27 


47.66 


45.48 1 43.30 


50.87 


28.09-73.66 


0.03 


0.88 


0.91 0.74 


Air Pollution 




60.29 


59.35 


58.29 58.05 


58.23 


50.82-65.64 


0.50 


0.64 


1.14 0.91 


Alligator 


pre 


52.55 


51.62 


51.96 


47.18 


48.49 


28.96-68.02 


0.19 


0.02 


6.54* 0.97 


Water Pollution 


pre 


59.58 


59.39 


57.95 


57.63 


59.18 


52.47-65.89 


0.02 


1.29 


1.44 0.42 


DISCUSSION VARIABLES 
Gall-Crown Discus. Attitude J 
Att. toward Thought Ques. 


cale: 
pre 


30.29 


31.14 


30.31 


30.36 


28.60 


23.03-34.17 


0.54 


0.51 


0.05 0.06 


Attitude toward Discussior 


pre 


54.86 


56.45 


54.97 


54.06 


53.69 


47.82-59.56 


1.80 


1.57 


1.71 0.43 


GENERAL TREATMENT VARIABLES 
Ecology Unit Opinions Scale; 
Attitude toward Peers 




15.88 


16.14 


16.41 


16.19 


16.00 


13.57-18.43 


0.12 


0.13 


0.01 0.01 


Attitude toward Teacher 




55.88 


57.57 


56.63 


54.65 


58.37 


50.81-65.93 


1.60 


0.49 


2.99 0.65 


Attitude- toward Curriculum 




29.97 


31.36 


31.18 


29.50 


30.86 


27.82-33.90 


2.68 


1.93 


1.80 0.37 


TREATMENT-SPECIFIC VARIABLES 
Ecology Discussion Attitude S 
Att. toward Thought Ques. 


cale: 


31.56 


33.20 


32.27 








4.18 


3.42 




Attitude toward Disc. 


GDAS-Disc. 
pre 


57.76 


59.88 


57.94 








5.92* 


7.23* 




Written Exercise Attitude Sea 
Att. toward Thought Questi 


le: 
ons 










31.68 










Attitude toward Writt. Ex£ 


r. 










35.82 










Ecology Art Project Sca'iJ: 
Attitude toward Art Projec 


ts 








61.85 













J . r> * Significance at the .05 level. The .05 levels for F values with the following degrees of freedom are: 
>140 ■. Fi.i7=4.45 F2, 17=3.59 F3,17=3.20 F6,17=2.70 F9,17=2.49 

a 

Heans for Art Activity Treatment I differ from the actual means because the missing cell value was estimated 
in the analysis of variance. 

^ Prop. = Sum of squares for Treatments 1, 2, 3 vs. 4 as a proportion of total treatment sum of squares. 

o 
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F-statistics for the planned comparisons; and the final column, labeled 
"Prop," is the proportion of variability among the four treatments accounted 
for by the differences between the mean of the discussion treatments and 
the non-discussion treatment. 

Planned comparisons of the discussion treatments (probing and re- 
direction versus no probing and redirection, no probing and redirection 
versus filler activity) revealed only a single difference which was. 
statistically significant. The no probing and redirection treatment mean 
was statistically greater than both the probing and redirection treatment 
mean and the filler activity treatment mean on the Attitude toward 
Discussion Subscale of the Ecology Discussion Attitude Scale. This was 
the same subscale which showed a significant difference in the analysis 
of variance for the main effect of treatment. However, because of the 
substantial number of statistical tests which were performed, it is quite 
probable that these findings are chance results. 

One research objective of Study I was to determine what student 
learning outcomes were affected by presence or absence of probing and 
redirection in discussion. The results indicate that presence of 
probing and redirection techniques in discussion does not promote more 
positive student attitudes toward curriculum-related topics or discussions 
in general than discussions where these are absent; also, use of such 
te chniques is not perceived any more favorably than their absence. 
It should be noted, however, that on the whole students were highly 
positive about all discussion situations. 

The planned comparison of the average of the three discussion.treat- 
ments versus the art activity treatment revealed one significant difference-- 
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students' scores on the Alligator Subscale of the Word Association Scale. 
The proportion of total between-treatment variability in the attitude 
measure scores accounted for by planned comparisons of discussion versus 
art activity was generally lower than was found for the achievement measures 

Since the treatment-specific attitude scales incorporated different 
items and were of different lengths, their mean scores cannot be compared 
directly. However, a rough comparison can be made by computing the students 
average rating per item,* since each scale used the same four-point rating 
scheme: strongly agree, agree, disagree, strongly disagree. For the 
single significant difference in treatment means, the average rating per 
item on the Attitude Toward Thought Questions Subscale was 2.94 for students 
in the discussion treatments and 2.88 for students in the written exercise 
treatments. The mean on the Attitude toward Discussion Subscale was 3.0b 
for the students in all discussion treatments. The art activity students 
had an average rating of 3.26 on the comparable scale (Ecology Art Project 
Scale) and the students in the written exercise treglment had a mean score 
of 2.99 on the comparable scale (Attitude Toward Written Exercises). 

These results relate to another research objective of Study I, which 
is to determine what student learning outcomes are affected by presence 
or absence of discussions. The results indicate that discussion treatments 
are equally as effective as a competing no-discussion treatment in promoting 
positive student attitudes toward curriculum-related topics and toward 
discussions in general; both types of treatment are perceived favorably . 



* The rating is obtained by dividing the total score by the number of items 
in the scale. 
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The uriadjusted cell means of the attitude scales for the written 
exercise treatment are presented in column 7 of Table 20. The column 
labeled "95% limits for Treatment £" prisants a confidence interval about 
each written exercise treatment mean. To the extent that other treatment 
means lie within this confidence band, the written exercise treatment 
probably can be judged approximately as effective as those other treatments.* 

Applying this procedure to the attitude scales, it appears that none 
of the discussion treatment means or art activity means on the attitude 
scales fell outside of the 95 percent limits for the corresponding written 
exercise treatment means. This finding is surprising given that the 
ecology teachers reported considerable difficulty maintaining student interest 
in the written exercise activities. 

As noted earlier, the scores of the written exercise treatment group 
on their treatment-specific scale (Written Exercise Attitude Scale) cannot 
be compared directly to the scores of the other* treatment groups on their 
respective treatment-specific scales (Ecology Discussion Attitude Scale 
and Ecology Art Project Scale). However, as on page 96, a rough compari- 
son can be made by computing the students' average rating per item. The 
average rating per item for each scale is presented in Table 21. Students 
in the written exercise treatment generally gave positive ratings on a 
four-point scale to their learning experiences. Their ratings were only 
slightly less positive than ratings of students in the combined discussion 
treatments and moderately less positive than ratings of students in the art 
activity treatment. 

5f Additional information about computation of the confidence limits is 
presented on page 83. 
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Table 21 

study I 

Average Ratings Per Item of Treatment-Specific Attitude Scales 



TREATMENT GROUP 


SCALE 


AVERAGE 
RATING 
PER ITEM 


Combined Discussion 
Treatments 


Ecology Discussion Attitude Scale 
Attitude Toward Thought Questions 
Attitude Toward Discussion 


2.94 
3.08 


Art Activity 
Treatment 


Ecology Art Project Scale 


3.26 


Written Exercise 
Treatment 


Written Exercise Attitude Scale 
Attitude Toward Thought Questions 
Attitude Toward Written Exercises 


2.88 
2.99 



These results relate to the third objective of Study I concerning the 
relative effects on student learning of teachers' discussion questions com- 
pared with the same questions in written format. It appears that questions 
in written format generally are as effective as questions in discussions 
in promoting positive attitudes toward curriculum-related topics and toward 
discussions in general; and they are perceived with approximately equal 
favorability as a learning experience . 

Classroom, Teacher, and Square Effects 

Classroom Effects . As reported in Table 19, there were statistically 
significant differences between classrooms for most of the scales measuring 
attitudes toward teachers and teaching methods. The omega squared values 
were generally large for these measures, ranging from .08 to .33, with a 
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median of .29. No significant effects were found for attitudes toward 
ecology. While the similarity of the various Study I treatments to the 
students* regular classroom experiences was not investigated, the presence 
of the classroom effect suggests that the regular learning environment 
of the students may have had a significant effect upon the outcomes. The 
importance to the study of the Latin square design in which all treatments 
were included in each class Is underlined by this finding. 

Teacher Effects . The main effect for ecology teachers was statistically 
significant for the two subscales of the Ecology Discussion Attitude Scale 



and approached significance for two others--the Attitude toward Discussion 
subscale of the Gall-Crown Discussion Attitude Scale and the Attitude toward 
Peers subscale of the Ecology Unit Opinions Scale. The omega squared values 
ranged from .00 to .41, with a median of .11. Non-controlled differences 
in teachers appear to have had more impact on attitudinal outcomes than on 
achievement outcomes. 

Square Effects . The main effect for squares was statistically signifi- 
cant for only one subscale (the Attitude toward Curriculum subscale of the 
Ecology Unit Opinions Scale), and can be attributed to chance- 

Square by Treatment Interactions . None of the square by treatment 
interactions were significant. 

STATUS VARIABLES 

Treatment Main Effects 

To assure that the results for various post and delayed measures 
were not simply reflecting pre-existing, differences among the students 
assigned to the various treatments, analyses of variance were performed 
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on the total reading scores; that is, the sum of Vocabulary and Compre- 
hension Subscale scores from the Comprehensive Tests of Basic Skills, 
and on average number of treatment lessons attended by students within 
a group. Table 16 (see page 78) presents the results of this analysis. 
No effects significant at the 5 percent level were observed, and omega 
squared values were generally small, ranging from .01 to .13 across the 
analysis of variance effects. 

Planned Comparisons . The status variables of verbal ability and 
session attendance were analyzed in three planned comparisons involving 
the following treatment means: probing and redirection versus no probing 
and redirection, no probing and redirection versus filler activity, and 
the combined discussion treatments mean versus art activity. These 
results are presented in Table 17 (page 82). 

None of the planned comparisons was statistically significant at the 
.05 level. However, the comparison of the combined discussion treatments 
mean and the art activity mean on the verbal ability measure approached 
statistical significance. The probing and redirection treatment mean is 
greater than the two treatments in which probing and redirection were absent; 
and their combined mean is greater than the art activity treatment mean. 
It therefore seems reasonable to conclude that differential absenteeism 
among treatment groups is unlikely to have been influential in producing 
treatment differences on achievement test and attitude scale results. 
However, there is a possibility that at least some of the observed treat- 
ment differences on achievement tests and attitude scales may have been 
the result of differential verbal ability. 
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SUMMARY 



The results of Study I can be sunmiarized by referring to the three 
research objectives which guided this study. 

1. The first research objective was to determine what learming 
outcomes were affected by presence or absence of probing and redirection 
techniques in discussion. The results of the data analyses in Study I 
indicate that probing and redirection did not facilitate students' 
acquisitioin of knowledge, higher cognitive response ability, or question- 
generating ability more than use of discussions in general; nor did these 
techniques promote more positive student attitudes toward curriculum- 
relat^?d topics or toward discussions than did discussions in general. 
Also, use of such techniques during discussions was not perceived any 
more favorably than their absence. 

2. The second research objective was to determine what student 
learning outcoiraes were affected by presence or absence of discussions. 
The results of the data analyses in Study I indicate that discussions 
were more effective than a competing instructional method (art activity) 
in facilitating students' acquisition of knowledge, higher cognitive 
response ability, and question-generating ability. Both instructional 
methods were perceived positively by students. 

3. The third research objective was to determine the relative 
effect on student learning. of teachers' questions delivered in discussion 
compared with the same questions presented and answered in written format. 
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The results of the data analyses in Study I indicate that questions in 
written exercises were as effective as questions in discussions in facili- 
tating knowledge acquisition and question-generating ability; and they 
were also as effective as discussion questions in promoting positive 
attitudes toward curriculum-related topics and toward discussions in 
genera). However, written questions were not as effective as discussions 
in w;hich questions were probed and redirected in facilitating higher 
co'jnitive response ability. 

As a tentative generalization, it might be said that it is important 
for teachers to conduct discussions to supplement students' reading/viewing 
of curriculum material. However, inclusion of specific discussion tech- 
niques (i.e., probinc) and redirection) does not appear to be as important 
as whether the discussions are conducted. Further, written exercises 
apparently can be substituted for discussions to promote learning, except 
when the teacher is seeking to stimulate students' ability to give higher 
cognitive responses. For this type of learning objective, discussion by 
probing and redirection is the preferred method. 

Analysis of other effects in the Latin square design--teacher, class, 
square, and treatment by square did not reveal striking or unexpected 
findings. Perhaps most noteworthy is the absence of a significant teacher 
effect in the analysis of variance, indicating that differential teacher 
characteristics did not influence implementation of the various treatments. 

The analysis of reading ability scores revealed some pre-existing 
differences among treatment groups which may have accentuated observed 
treatment effects. However, since these differences were not statistically 
significant, they do not present a significant competing hypothesis for 
interpreting findings. - , 
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SECTION III 



STUDY II 

The Effects of Teacher Use of 
Higher Cognitive Questions 
on Student Achievement and Attitudes 



The report of Study II, The Effects of Teacher Use of Higher Cognitive 
Questions on Student Achievement and Attitude, is organized into the same 
three major chapters as the report of Study I: first, the methodology of 
the experiment is described; second, the results of the experiment are 
presented; finally, there is a discussion of the results of both Studv I 
and Study II. Technical issues are discussed in the appendices. 
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CHAPTER FIVE 
METHODOLOGY OF STUDY II 

The discussion of methodology covers six main topics: treatments, 
curriculum, participants including both teachers and pupils, instru- 
mentation, research design, and analysis. 

TREATMENTS 

As with Study I, the discussion of treatments includes two subtopics. 
The first is a description of the treatments and the procedures related 
to their implementation. The second is a discussion of the fidelity of 
treatment in Study II. Fidelity of treatment provides information on the 
disparity between the intended treatment and the actual treatment as 
implemented by the participants. The more closely the actual treatment 
corresponds to the intended treatment, the greater the treatment fidelity 
is said to be. Fidelity of treatment is an important aspect of this kind 
of experiment because results can be contaminated by uneven or idio- 
syncratic implementation of the intended treatment. 

Description of Treatments 

Study II included four treatment conditions—three discussion treat- 
ments and an art activity treatment. The treatments were administered to 
students randomly formed into treatment groups from sixth-grade classrooms 
in a single school district. All of the treatments used a specially prepared 
curriculum on ecology. The curriculum is fully described on pages 29 to 
37 of this volume. The treatments were administered by specially- 
trained teachers (referred to in this report as ecology teachers), not by 
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the students' regular teachers. Each ecology teacher taught four different 
treatment groups each day. A discussion follows of each of^^the treatment 
conditions. 

Discussion Treatments . As noted above, the three discussion treatments 
in Study II all used the ecology curriculum. As in Study I, this curriculum 
consisted of one warm-up lesson and nine regular lessons, one lesson a day 
was conducted during a fifty-minute session. Presentation of curriculum 
materials typically required 15 to 20 minutes. The next 20 to 30 minutes 
were used for the various types of discussions. Each discussion, irrespective 
of treatment condition, consisted of 16 questions. TJie decision to use 16 
questions was based upon pilot work which indicated that teachers in the 
sixth grade typically can ask 15 to 20 substantive questions in a 20 to 30 
minute period without a time difficulty for either the teacher or the 
students. 

Depending upon the discussion treatment, the 16 questions w^re variously 
divided among fact, multi-fact, and higher cognitive questions. The fact 
and mcOti-fact questions corresponded to Bloom's knowledge levels. The 
higher cognitive questions were based on the processes included in the 
upper levels of Bloom's cognitive taxonomy. 

Tho criteria used to generate the face and multi-fact questions were 
the same as those applied in Study I (See pp. 18 to for discussion 
of procedures used to generate the queiitions). 

The three d/'scussion treatments* that were developed to test effects 
of higher cognitive questions were as follows: 

* The discussion treatments were pilot tested as part of the initial try-out 
of the ecology curriculum. See pages 35 to 37 for a description of the 
pilot test. 
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25% Higher Cognitive Question (HCQ) Treatment , This treatment con- 
sisted of nine discussions each of which contained eight fact questions, four 
multi-fact questions, and four higher cognitive questions. The discussion 
questions which comprised the nine lessons are presented in Volume II. The 
ecology teachers were trained to ask these questions exactly as given to 
them. In addition, they were instructed to probe and redirect the multi- 
fact and higher cognitive questions, as appropriate. In effect, this treat- 
ment was equivalent to the probing and redirection treatment in Study I 
except for the different proportion of higher cognitive questions. These 
discussions were approximately 17 minutes in length. An additional 12 
minutes of filler activity was assigned for each lesson in order to equate 
length to that of the 75 percent treatment. The filler activities in this 
treatment and in the 50% HCQ treatment were drawn from the filler activity 
treatment in Study I; see page for a description of the filler activities. 

50% Higher Cognitive Question (HCQ) Treatment . This treatment 
was identical to the probing and redirection treatment in Study I. The 
discussions contained the same four multi-fact and same four higher cognitive 
questions as in the 25% HCQ treatment. However, four additional higher 
cognitive questions (not in the 25% HCQ treatment) were included while 
only four of the fact questions contained in the 25% HCQ treatment were 
used. These discussions lasted approximately 23 minutes. Ari^additional 
six minutes of filler activity was assigned to each lesson in order to 
equate time with the 75 percent treatment. The questions for this treatment 
also are presented in Volume II. 

75% Higher Cognitive Question (HCQ) Treatment . This treatment 
consisted of nine discussions each of which included four multi-fact 
questions and twelve higher cognitive questions (see Volume II for listing 
of questions). The four multi-fact questioris were the same as those in 
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the preceding two treatments. Of the twelve higher cognitive questions, 
four were unique to this treatment; four appeared in both this treatment 
and the 50% HCQ treatment; and four were common to all the discussion 
treatments. The 75 percent HCQ discussions were expected to require 
approximately 29 minutes to complete. 

The "semi-programmed discussion" technique used in Study I also was 
applied here. In this technique, the teacher follows a script which 
prescribes the questions to be asked and in what sequence. The script is 
only "semi" programmed because some teacher behaviors are contingent upon 
student responses. For example, in Study II teacher probing and redirection 
of multi-fact and higher cognitive questions was contingent upon the student's 
response. If a student was unable to express a response to the initial 
question (e.g., an "I don't know" response), the teacher could not probe to 
elicit a rationale or elaboration of the answer. Thus, the script could 
dictate the question to be asked and approximately how many times probing 
was to occur but it could not prescribe which student responses would be 
probed. 

To insure that students in all discussion treatments were exposed to 
the same amount of correct information, a set of exemplary responses was 
provided for each question. Whenever no student gave an acceptable answer 
to a question, the teacher provided one from this set. 

The reason for using the semi -programmed discussion format was to 
control, as much as possible, the content and form of the treatment 
received by the students. 

Art Activity Treatment . This treatment was the same as the art activity 
in Study I except each treatment group in Study II contained more students. 
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The students in this treatment viewed and/or read the same ecology curriculum 
materials as the students in the discussion treatments. Instead of discussion 
though, they participated in nine sessions of ecology-related art activities. 
During these sessions, the ecology teachers were instructed to ask none of 
the questions incorporated in the various discussion treatments. The time 
allotted for each art activity lesson was approximately equal to that of 
the 75 percent HCQ treatment, 29 minutes. 

The sequencing and types of art activities were allowed to vary at 
the discretion of the ecology teachers. Each teacher was given a packet 
of art activity suggestions. A particular activity could l«>st for one 
period or could be continued over successive days. A description of 
some of the activities is included in the Study I report (see page 21 .) . 

Sunmiary of Treatments . Table 22 summarizes the similarities and 
differences among the four treatment conditions used in Study II. 



TABLE 22 



Study II Treatments 



Treatment 



Content 



25% Higher Cognitive 
Questions 



Curriculum materials followed by discussion 
including 8F + 4MF + 4HCQ + probing and re- 
direction. 



50% Higher Cognitive 
Questions 



Curriculum materials followed by discussion 
including 4F + 4MF + 8HCQ + probing and re- 
direction. 



75% Higher Cognitive 
Questions 



Curriculum materials followed by discussion 
including 4MF + 12HCQ + probing and redirection. 



Art Activity 



Curriculum materials followed by ecology- 
related art activity. 



F = Fact question 
MF = Multi-fact question 
HCQ = Higher cognitive question 
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Fi delity of Treatment 

Fidelity of treatment was verified along two dimensions. First, a 
check was made on how well teachers implemented the treatment as defir<.'d 
in the semi-programmed instructions. Second, the time required for treat- 
ment implementation was checked. The results of both of these checks follow. 

Adherence to treatment conditions . Since the discussion treatments 
were semi-programmed, adherence to the conditions of question sequence 
and use of probing and redirection were essential for maintenance of 
treatment. In the art activity treatment, it was essential that the 
teachers conducted no discussions. 

As in Study I, the extent to. which the ecology teachers in Study II 
maintained the various discussion treatment conditions was checked by 
audiotaping three of the discussions conducted by each teacher on each 
of two days (Lesson 2 and Lesson 7). This sample of six discussions per 
teacher was rated to establish treatment fidelity. A total of 72 discus- 
sions were rated for Study II. These were contained on a set of 52 
audiotapes which included discussions from both Studies I and II. Thirty 
of the tapes were scored by two raters. Twenty-two tapes were scored by 
only one rater due to cost considerations. Since the tapes were assigned 
for scoring on a random basis, there is no reason to believe that the 
ratings of the single-scored tapes differed systematically from the 
double-tscored tapes. 

The audiotapes first were scored to determine whether the ecology 
teacherw^v 

- asked (or omitted) each of the 16 scripted quesions; 

- made substantial changes in the wording of a question; 

- asked the questions in a different order than they were listed in 
the script. 
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Based upon this analysis, the teachers appeared to have followed the question 
format. Deviations from the scripts were so infrequent that a statistical 
summary was not necessary. In only six of the 144-discussions which were 
audiotaped in Study I and Study II (72 in each study), did teachers vary 
the order of the questions. Other deviations either did not occur or 
occurred very infrequently. 

The audiotapes also were rated for frequency of several teacher 
behaviors which reflected implementation of the treatment conditions. These 
behaviors included probing, redirection, praise, giving feedback about the 
accuracy of a student* s answer, and giving all or part of an answer to 
the question (rather than the students giving the answer). Interrater 
agreement on the frequency of occurrence of these behaviors was checked 
for those audiotapes scored by both raters. The intraclass correlation 
coefficients for the double ratings were .93 for probing, .90 for redirection, 
.91 for praise, .65 for feedback, and .91 for giving answers. 

Table 23 presents the results of teacher use of the behaviors in 
Study II. Generally, the ecology teachers' performance reflected the instruc- 
tions given in their training for Study II. They were asked to probe and 
redirect each multi-fact and higher cognitive question, while staying 
within certain time limits. Since the 25%, 50%, and 75% higher cognitive 
question treatments contained progressively more of these types of questions, 
a progression in use of probing and redirection would be expected. This was 
in fact the case both in Lesson 2 and in Lesson 7. The same progression 
occurred, although not as clearly, in the other three behaviors: praise, 
feedback, and gives answer. The greatest difference occurred between the 
25% HCQ treatment and the other two treatments, which differed negligibly 
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TABLE 23 
Study II 

Teacher Behavior Patterns in Discussion Treatments 



Teacher Behavior 


lit m* 

fl= 12 Teachers 


50°/ m 

N= 12 Teaciiers 


75fc HCO 
N= 12 Teachers 


Y 
A 


^ n 

J.U. 


1 




A 


S.D. 


Lesson 2 














Probing 


14.09 


6.39 


18.08 


9.50 


24.40 


12.18 


Redirection 


17.46 


6.07 


25.83 


10.33 


28.28 


15.19 


Praise 


5.83 


. 6.13 


8.12 


7.09 


8.80 


10.20 


Feedback 


11.71 


5.91 


15.79 


8.12 


16.05 


6.44 


Gives Answer 


1.33 


1.29 


2.42 


2.56 


2.65 


2.48 


Lesson 7 














Probing 


14.73 


4.17 


18.40 


7.62 


28.25 


13.20 


Redirection 


16.50 


?23 


■22.65 


10.00 


30.25 


13.37 , 


Praise 


4.86 


•73 


6.45 


5.19 


4.96 


4.56 


Feedback , 


10.18 


4.91 


13.30 


7.15 


16.83 


6.20 


Gives Answer 


2.00 


1.94 


1.45 


1.40 


2.08 . 


1.76 



* HC(1 = Higher Cognitive Questioning 



between themselves. The progression can be explained in terms of the 
opportunity for praise and feedback and for aivina answers in the 50°^ HCQ 
and 75% HCQ treatments, compared to the 25% HCQ treatment. Nonetheless, 
inspection of the standard deviations for the treatment means indicates 
considerable overlap in the range of use of the behaviors among the 
treatments. 

Adherence to treatment conditions for the art activity treatment v/as 
monitored by staff observations of randomly selected lessons. (The audio- 
tape procedures were not used because few verbal events occurred that 
could be scored in a manner that was meaningful to the study.) Generally 
the prescribed conditions were maintained. 

Average length of treatment sessions . In Study II the ecology 
teachers were asked to maintain a diary in which they recorded the length 
of each treatment session they taught. These times were compiled and 
summarized in order to determine how closely the average times approxi- 
mated the pre-study estimates for each discussion treatment: 17 minutes 
for 25% HCQ treatment, 23 minutes for 50% HCQ treatment, and 29 minutes 
for 75% HCQ treatment. No analysis was necessary for the art activity 
treatment since each session was stopped at the end of 29 minutes. 

Table 24 contains the estimated times for each discussion treatment 
for eaciv teacher. These times are for the discussion portion of the 
treatment only. They do not include the additional 12 minutes of filler 
activity that occurred in the 25% HCQ treatment or the 6 minutes of ^ 
filler activity for the 50% HCQ treatment. The filler activity time 
must be added to the average length of discussions to obtain the total 
time for these two treatments.. -Based.up^n the mean fimes for the treat- 
ments- over all teachers and lessons, the average times for the various 
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TABLE 24 
Study II 

Average Length of Discussion Treatment Sessions 



Y 1 

Teacher 


25% Higher 
Cognitive Questions 


m Higher 
Cognitive (luestions 


m Higher 
Cognitive Questions 




J 

Freouencv 


' 'S.D. 


Frequency 


S.D. 


Frequency 


S.D. 


1 


17.56 


1.01 


21,89 


3,59 


28.56 


4.44 


2 


15.56 


2.79 


21,00 


1.73 


26.89 


3.06 


3 ' 


15.14** 


3.24 


22.63* 


1.60 


29.22 


2.05 




16.22 


1.72 


22.44 


2.79 


27.00* 


2.88 


5 


14.89 


2.89 


20,33 


5.66 


26.25* 


4.59 


6 


17.11 


1,45 


22.38* 


3.42 


28.89 


3.59 


1 


17.88* 


4.02 


24.75* : 


5.99 


29.50* 


4.11 


8 


15.43** 


1.81 


21.00** / 


4.24 


27.14** 


1.87 


•9 


15.56 


1,33 


23.33 


1.12 


30.89 


4.01 


10 


18.75* 


1,39 


24.25* 


1.39 






11 


15.89 


2.98 


16.44 


2.96 


23.33 


2.74 


12 


14.89 


2.42 


21.33 


1J3 


22.78 


5.07 


TREATMENT X 


16.24 


1,28 


21.81 


2.15 


27.65 


2.66" 



I 

NOTE: Mean based on nine lessons except when indicated by asterisk 

, I — 



* = 8 lessons; **= 7 lessons 



discussions are very close to the expected times. Adding the filler activity 
time to the 25" HCQ and 50% HCQ treatments, the mean times for the treatments 
were as follows: 28.24 for the 25% HCQ treatment, 27,81 for the 50% HCQ 
treatirent, and 27.65 for the 75% HCQ treatment. 

Individual teachers fell somewhat below the expected times in some 
treatr^ents. For example, on the average, teachers 5 and 12 were low in 
the 25: HCQ treatment, teacher 11 was low in the 50% HCQ treatment, and 
teachers 11 and 12 were low in the 75% HCQ treatment. If a teacher effect 
appears m the results for Study II, consideration should be Qiven to 
tne effects of these teachers. 

CURRICULUM 

The ten lesson ecology curriculum used in Study I also was used in 
Study II, Details concerning the content, development, and pilot testing 
of this curriculum are included in the report of Study I (see pages 29 
to 37 of this volume). A copy of the printed materials used in the 
curriculum Is included in Volume II of the report. 

STUDENTS AND TEACHERS 

Students 

The sij;th grade was selected as the grade level at which Study II 
would be conducted in order to work with students who had developed 
sufficient reading skills to facilitate use of the ecology curriculum 
and also to utilize a student sample similar to the one which participated 
in Study I . 
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study II was conducted in the Novate Unified School District, Novato, 
California. Recruitment procedures followed the sanie plan as in Study I 
(See page 39). A total of 12 sixth-grade classes, two in each of six 
schools, volunteered for Study II. A total of 371 students from these 
classes served as the sample for the study. 

Since the reading level of the students was considered important 
to the use of the curriculum materials, the students' scores on a state- 
administered reading test, the Comprehensive Tests of Basic Skills, 
were examined. This test was administered at the beginning of the school 
year in which the study was conducted. Table 25 presents the mean 
score and grade equivalent for all students participating in the study. 

TABLE 25 
Study II 

Mean Reading Scores of Students 



VOCABULARY 


COMPREHENSION 


VOCABULARY PLUS 
COMPREHENSION 


Grade* 

X S.D. Equiv. 


Grade 

X S.D. Equiv. 


Grade 

X S.D. Equiv. 


30.46 (6.89) 6.0 


33.26 (9.39) 6.2 


63.72 (14.05) 6.2 



* Grade equivalents obtained from Examiner's Manual . Comprehensive Tests 
of Basic Skills. Monterey, California: McGraw-Hill, 1968, pages 48-49. 



Teachers 

The same 12 teachers participated in Study II as Were in Study I. 
These teachers were recruited from a group of 100 teachers selected at random 
from the substitute teacher list of the San Francisco Unified School District. 
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Teacher recruitment and training procedures are described on pages 39 
to 41 of this volume. 

INSTRUMENTATION 

In order to study the effects of teacher use of higher cognitive 
questions upon student outcomes, two aspects of student performance were 
investigated: 

(a) student achievement at both fact recall and higher cognitive 
levels and in terms of both written and oral modalities; and 

(b) student attitudes regarding the various treatment parameters. 

A total of seven achievement measures and six attitude measures were used 
in the study. Every student irrespective of treatment, completed the *same 
set of tests with the exception of the treatment-specific attitude scales. 
With respect to the latter, the particular scale administered to the student 
depended upon the treatment in which he or she participated. Tables 26 
and 27 list the achievement and attitude instruments, respectively, and 
provide information about the specific variables measured by each instru- 
ment and the point of administration in the study. 

Since these instruments are the same measures used in Study I, the 
discussion of their purpose, format, and construction are not repeated 
here. This information is presented on pages 41 to 60 of the report. 
Additional statistical information concerning the instruments is included 
in Appendix C of this volume and in Volume IV. Copies of the instruments. 
Scoring keys, and scoring manuals are contained in Volume III. 
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TABLE 26 
Study li 

Achievement Measures 



INSTRUMENT 


VARIABLES MEASURED 


POINT OF 
ADMINIS- 
TRATION 


APPROXIMATE 
TESTING 
TIMF** 

1X1 11- . 


Comprehensive Tests of 
Basic Skills-Reading 


Vocabulary; Comprehension 


Pre* 


52 minutes 


Ecology Information 
Test 


Amount of information about 
ecology 


Pre, post, 
delayed 


15 minutes 


Oral Test 


Ability to state orally 
opinions, predictions, 
solutions, inferences, etc. 


Pre, post 


10 minutes 


Essay Test 


Ability to state in writing 
opinions, predictions, 
solutions, inferences, etc. 

Ability to state in writing 
reasons and if-then 
relationships. 


Pre, post 


25 minutes 


Population Test 


Ability to state in writing 
opinions, predictions, 
solutions, inferences , etc. 
Ability to state in writing 
rPa^on^ and i'f-thcn 
relationships. 


Delayed 


25 minutes 


Ques ti on-Gehera ti ng 
Test: Paper-and- 
Pencil Measure 


Ability to generate 
questions. Quality of 
questions generated. 


Pre, post 


20 minutes 


Question-Generating 
Test: Oral' Measure 


Ability to generate 
questions. Quality of 
questions generated. 


Pre, post 


2 minutes 



* Data collected by the participating school district, not by the researchers. 

These are average times for test administration. All tests except the 
Question Generating Test (Paper-and-Pencil Measure) were primarily power tests. 
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TABLE 27 
Study II 
Attitude Scales 



SCALE 


VARIABLES MEASURED 


POINT OF 
ADMINIS- 
•TRATION - 


APPROXIMATE 
TESTING 
TIME 


Word Association 
Scale 


Attitude toward 
Ecological Concerns 


Pre, post 


10 minutes 


Gall -Crown 
Discussion Attitude 
Scale 


Attitude toward Class 
Discussions 

Attitude toward 
Thought Questions 


Pre, post 


15 minutes 


Ecology Unit Opinions 


Attitude toward 
Treatment Group Peers 

Attitude toward Ecology 
Teacher 

Attitude toward Ecology 
Curriculum 


Post 


15 minutes 


Ecology Discussion 
Attitude Scale 


Attitude toward Discussion 
in Discussion Treatments 

Attitude toward Thought 
Questions in Discussion 
Treatments 


Post 


15 minutes 


Ecology Art Project 
Scale 


Attitude toward Art 
Activities in Art 
Activity Treatment 


Post 


10 minutes 
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Certain aspects of the instruments and/or their scoring and rating 
should be noted in order to aid in the interpretation of Study II find- 
ings. A discussion follows of these study-specific factors. ' — 

Achievement Measures 

The achievement measures included one measure of general ability and 
six measures of fact and higher cognitive outcomes related to the ecology 
curriculum unit. 

Comprehensive Tests of Basic Skills (CTBS) . Student scores on the 
Vocabulary (40 items) and Comprehension (45 items) subscales of the CTBS 
(Form Q-Level 2) were obtained from the school district. The scores 
were based upon the results of the October 1973 statewide testing. program. 

In Study II, the correlation between the Vocabulary and Comprehension 
Scales was .52; the correlation of these scales with the combined scale 
(total reading score) was .90 and .76, respectively. 

Other information concerning this instrument may be found in Chapter 
Three and in Volumes II and IV. 

Ecology Information Test (EIT) . The EIT was designed to measure 
students* acquisition of factual information in the ecology curriculum. 
In Study II, the test was formed into three subtests: 

- Intentional Scale II > Consisted of eight items which measure 
recall of information covered in the discussion treatments. This 
scale, therefore, was intentional for 25, 50, and 75^ higher cognitive 
question treatments. It was incidental for the art activity treatment. 

- 25% HCQ Incidental Scale II . Consisted of seven items which were 
taken from fact questions asked in the 25% HCQ treatment. The items 
were incidental for all other treatments. 

- Incidental Scale II . Consisted of ten items which were incidental 
for all treatments. 
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See Chapter Three and Tables C-1 and C-2 of Appendix C for further infor- 
mation. Also refer to Volumes III and IV. 

Oral Test . For a discussion of test purpose, content, and rating . 
procedures refer to Chapter Three of this volume. The correlations between 
the oral test variables are reported in Table C-3 of Appendix C, other 
technical data regarding the test are contained in Volume IV. Volume 
III includes a copy of the test and the scoring procedures. 

Two additional features of the Oral Test need to be considered when 
interpreting the results of Study II. These are: (a) the rating procedures 
and interrater reliabilities; and (b) the effects of cues on the audiotape 
recordings of the students' responses which indicated whether the recording 
was a pre-or posttest. A discussion of these factors follows. 

Rating Procedures . Six raters were trained to a satisfactory 
level of perforniaRoe using a set of "training tapes." These raters then 
were randomly paired and each pair was randomly assigned a set of audio- 
tapes to rate. Interrater reliability was calculated by the intraclass 
correlation coefficient across all pairs of raters. Separate coefficients 
were computed for pre and post tapes for Study II (and Study I). Co- 
efficier'- the Content Scale ranged from .80 to .84. For the Logical 
Extension Scale in Study II, the pretape and posttape coefficients were 
.64 and .77, respectively. 

Effects of Cues . Although the raters were not told which class- 
room or treatment group they were rating, the audiotapes contained some 
statements by the tester which identified the point of test administration. 
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For example, a tester might remark, "Don't worry; youMI learn more about 
this later.'* Raters were instructed to note on their forms when such an 
indicator occurred. 

The rating forms were analyzed to determine the 'frequency and 
distribution of these indicators. Such indicators occurred more often 
than would be desired in Study II. However, the distribution- af the 
occurrences was fairly even across the treatment conditions. Table 28 
presents these data. 

TABLE 28 
Study II 

Percentage of Ural Test Tapes Having Pre-Post Indicator 



TREATMENT 




PERCENTAGE OF TESTS 


HAVING PRE- POST INDICATOR 






Pre 


Post 


25% HCQ* 




4% 


47% 


50% HCQ 




0 


44% 


75% HCQ 




4% 


41% 


Art Activity II 




1% 


41% 



*HCQ = Higher Cognitive Question 



A supplemental analysis was done to determine whether the indicators 
influenced raters to assign higher or lower scores than when the indicators 
were not present. The analysis compared the raters' mean rating of 
indicator posttapes with their mean rating of non-indicator posttapes 
within the same treatment. The results are shown in Table 29. 
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TABLE 29 
Study 11 

Comparison of Oral Test Posttest Ratings for 
Post" Indicator Present Versus ^Post" Indicator Absent 







2551 m 

TREATMENT 


m m 

TREATMENT 


75^ HC(| 
TREATMENT 


1 ART ACTI'VITy 
TREATMENT 


Variable 


Indicator 


Number 
of 

Tapes 


I 

Rating 


S.D. 


t 


Number 
of 

Tapes 


J 

Rating 


S.D. 


t 


Number 
of 

Tapes 


I 

Rating 


S.D. 


t 


Number 
of 

Tapes ' 


I 

Rating 


S.D. 


t 


LOGICAL 

EXTENSION 

SCALE 


Present 


30 


4.52 


2.36 


2.29* 


30 


3.97 


3.22 


0.19 


28 


2.68 


2,01 


i.n 


52 


3.34 


2.97 


1.87 


Absent 


38 


3.30 


1.97 


38 


3.84 


2.25 


40 


3.44 


3.15 


84 


2.56 


1.87 


CONTENT 
SCALE 


Present 


31 


9.24 


3.18 


1.34 


30 


8.67 


2.67 


0.82 


30 


7.63 


2.41 


1.45 


53 


8.22 


3.00 


3.36* 


Absent 


39 


8.33 


2.42 


39 


9.23 



2.86 


41 


8.74 


3.58 


88 


6.73 




2.2. 



*p<.05 
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As indicated in Table 29, the raters scored the posttapes with a post 
indicator higher than the posttapes without such an indicator on 5 of the 
8 comparisons. Two of these comparisons indicated a statistically ^ 
significant difference in the ratings at the .05 level. In Study II, 
therefore, presence of a post indicator needs to be taken into account 
in interpreting the results of the. OraV Test. Even though the indicators 
were fairly equally distributed across he treatments, the effects of 
these indicators upon the students* posttest scores may contribute to 
any differences in treatment effects that occur. 

Essay Test . The fourth achievement measure was the Essay Test. The 
purpose of this test was to measure students* ability to give plausible, 
reasoned, written responses to questions about the ecology curriculum. 
The test contained only questions requiring more than simple recall of 
information. The relationship of the questions to the Study II curriculum 
and the treatment conditions is presented in Table 30. 

Additional information on this test may be found in Chapter Three, 
Table C-4 of Appendix C, and in Volumes III and IV of this report. 

Transfer (Population) Test . See Chapter Three and Volumes III and 
IV of this report for information on this test. 

Question Generating Test (Paper and Pencil) . See Chapter Three an'cf 
Tables C-5 and C-6 of Appendix C of this volume and Volumes III and IV 
of this report for information on this test. 

Question Generating Test (Oral) . The Oral Question Generating Test 
was similar to the written version except that the students responded 
orally. Audiotapes were made of the students* responses. Each audiotape 
was rated for frequency of non-pertinent and pertinent questions and for 
overall quality. 

178 



TABLE 30 
Study II 
Derivation of Essay Test Items 



ITEM NO. CLASSIFICATION 


TREATMENT AND/OR CURRICULUM SOURCE 


1. Generalization 


Incidental question (not included in any discus- 
sion treatment), Pertdlns to content of Lesson 7. 


2. Generalization 


Modified version of a question which appeared in 
all discussion treatments for Lesson 7# 


3. Generalization 


Modified version of a question which appeared in 
the 75% HCQ treatment for Lesson 8, 


4. Opinion 


Incidental question. Pertains to content of 
^ Lesson 5,.'. ;"T7.., . > ■. ■. 


5. Interpretation 


Intentional question for all discussion treatments 
for Lesson 4. 


6. Solution 


Incidental question. Pertains to content of 
Lesson 3. 


7. Explanation 


Modified version of a question which appeared in 
the 75% HCQ treatment for Lesson 7. 


8. Opinion 


Modified version of a question which appeared in 
the 75% HCQ treatment for Lesson 5. 


9. Opinion 


Modified versi^)n of a question whtc?)' appeared in 
all discussion treatments for Lesson-Sv 


10. Prediction 


Modified version of a question which appeared in 
all discussion treatments for Lesson 2. 


11. Solution 


Modified version of a question which appeared in 
the 75%* HCQ treatment for Lesson 1. 


12. 'Opinion 


Incidental question. Pertains to content of 
Lesson 1. 
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Interrater reliability for Study II based upon interclass correlations 
across all raters ranged from .84 to .92 for pertinent questions; .80 to .86 
for the overall quality rating; and .46 to .50 for nonpertinent questions. 
The coefficients for nonpertinent questions are somewhat low. However, in 
view of the lov/ frequency of occurrence md the low range of scores for 
this variable, they are satisfactory. 

As with the Oral Test, ratings of this variable are susceptible to 
the presence of "post" indicators on the audiotapes. Table 31 presents 
the analysis of the effects of the post indicators. Presence of an 
indicator results in higher ratings than when no indicator is given in 
nine of the twelve comparisons that were made. Two of these comparisons 
showed statistically significant differences favoring the tapes with 
indicators. Thus, results related to this variable also must be inter- 
preted with the biasing effects of the indicators in mind. Differences 
among treatments may be affected by the "post" indicators as well as by 
treatment conditions. It should be recalled, however, that the indicators 
were fairly equally distributed across treatments so the bias may not be 
as critical as if it were concentrated in a particular treatment group. 

Attitude Scales 

Five attitude measures were administered in Study II. Three of 
these measures were administered to all students regardless of the treat- 
ment group to which they were assigned. They were the Word Association 
Scale, Gall-Crown Discussion Attitude^ Seal e, and .the Ecology Unit Opinion 
Scale. Two of the measures assessed students' attitude toward the 
specific treatment in which they participated. They were the Ecology 
Discussion Attitude Scale and the Ecology Art Project Scale. 
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ME 31 
'--" Study II 

Conparison of (juestion Generating Test (Oral) Posttest Ratinqs for 
"Post" Indicator Present Versus "Post" Indicator Absent 





25^ m 

TREATMENT 




50^ m 

TREATMENT 


m m 

TREATMENT 


ART ACTivny 

TREATMENT II 


Variable 


Indicator 


Number 
of 

Tapes 


I 

Rating 


S.D. 


t 


Number 
of 

Tapes 


J 

Rating 


S.D. 


t 


Number 
of 

Tapes 


X 

Rating 


S.D. 


t 


Number 
of 

Tapes 


J 

Rating 


S,D. 


t 


NON- 
PERTINENT 
(jUESTIONS 


h: ■ 


31 


0.05 


0.15 


(].4fa 


30 


0.35 


0.83 


2.05' 


30 


0.21 


0.51 


1.98^ 


53 


0.16 


0.4? 


0.46 


Absent 


39 


0.08 


0.33 


39 


0.06 


0.23 


41 


0.05 


0.04 


88 


0.13 


0.34 


PERTINENT 
(jUESTIONS 


Present 


31 


1.98 


1.29 


0.73 


30 


1.95 


1.40 


0.38 


30 


1.48 


0.90 


0.57 


53 


1.87 


1.84 


1.46 


Absent 


39 


1J3 


1.49 


39 


1.82 


1.38 


41 


1.66 


1.53 


88 


1.47 


1.38 


ljUAlITy 
RATING 


Present 


31 


1.05 


0.53 


0.07 


30 


1.17 


0.58 


0.69 


30 


1.10 


0.71 


0.45 


53 


0.91 


0.69 


1.02 


Absent 


39 


1.04 


0.65 


39 


1.06 


0.70 


41 


1.02 


0.72 


88 


1.07 


1.00 



1!50 



at 



p <".05 
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Information concerning each of these instruments is reported in 
Chapter Tliree, Tables C-8 through C-16 of Appendix C, and in Volumes III 
and IV of the report. 

RESEARCH DESIGN OF STUDY II 

The purpose of Study II was to test the effects of four instructional 
treatments i on student achievement and attitudes. 

Study II employed the same Latin square design as Study I. The 
reasons for selecting this design and the application of the design to 
the study are discussed on pages 61 to 62. 

Assignment of Schools and Classrooms 

Study II was conducted in a single school district lising i,wo sixth- 
grade classrooms from each c. six schools. The study was conducted by 
the same twelve ecology teachers as Study I. The complete design for 
Study II is presented in Table 32. 

The same procedures used in Study I (see page 64) were followed 
to assign the six schools and twelve classrooms of School District II 
to squares as shown in Table 32. Basically, each of thf- 
schools provided two sixth-grade classrooms for the itudy. Schools 
were paired, and each pair formed a separ te Latin square v;ith four 
classrojois. There were a total of three such Latin squares. 

Assignment of Teachers to Latin Squares 

The same twelve ecology teachers as in Study I participated in Stuiy I 
However, unlike Study I they could not be randomly assigned t-) Latv.i 'quare 

\ 
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study II 
Composition of Squares 



SQUARE 1 



tUuLUbY 


SCHOOL 7 


SCHOOL 8 


9AM* Class 13 


lOrOOAT^ Class 14 


12:30PM Class 15 


2:00PM Class 16 


Q 
O 


Treatment 6 
B=3 
G=3 


1 rca LiTlcn U O 

8=3 
G=3 


1 red Lmici 1 L 7 

E=5 

G=6 


1 1 ca uiNci 1 u / 

8=3 
G=3 


7 


1 1 ca UNCI 1 L O 

B=3 
G=3 


1 1 CQUmICMU f 

B=3 
G=3 


T'rp/n"*mpnt 6 

C--^3 


Trpatment 9 
8=5 
G=4 


10 


Treatment 9 
B=2 
G-11 


Treatment 6 
B=3 
G=3 


Treatment 7 
8=3 
G=3 


Treatment 8 
B=3 
G=3 


12 


Treatment 7 
B=3 
G=3 


Treatment 9 
8=6 
G=9 


Treatmprit 8 
8=3 
G=3 


Treatment 6 
B=3 
G=3 


SQUARE 2 


ECOLOGY 


SCHOOL 9 


SCHOOL 1 


0 


TEACHER 


9:00Af1 Class 17 


10:00AM Class 18 


12:30PM Class 19 


2:00 PM Class 20 


4 


Treatment 6 
B=3 
G=3 


Treatment 8 
8=3 
G=3 


Treatment 7 
fi=3 
■G=3 


Treatment 9 
8=0 , , 
G=7 


11 


Treatment 8 
B=3 
G=3 


Treatment 7 
8=3 
G=3 


Treatment 9 
8=8 
G=7 


Treatment 6 
8=3 
G=3 


1 


Treatment 9 . 

B=6 
G=6 


Treatment 6 
8=3 
G=3 


Treatment 8 
8=3 
G-3 


Treatment 7 
8=3 
G=3 


5 


Treatment 7 
B=3 
G=3 


Treatment 9 
8=3 
G=7 


Treatment 6 
B=3 
.".=3 


Treatment 8 
8=3 
G=3 


SQUARE 3 


ECOLOGY 
TEACHER 


SCHOOL n 


SCHOOL 12 




9:00AM Class 21 


10:00AM Class 22 


12:30PM Class 23 


2:00PM Class 24 


6 


Treatment 6 
B=3 
G=3 


Treatment 8 
8=3 
G=3 


Treatment 9 
8=7 
G=7 


Treatment 7 
8=3 
G=3 


2 


Treatment 8 
B=3 
G=3 


Treatment 7 
8=3 
G=3 


Treatment 6 
8=3 
G=3 


Treatment 9 
8=6 
G=8 


i 3 


Treatment 7 
B=3 
G=3 


Treatment 9 
8=6 
G=7 


Treatment 8 . 
8=3 
G=3 


Treatment 6 
8=3 
G=3 


9 


Treatment 9 
B=7 

1 G=7 


Treatment 6 
8=3 
G=3 


Treatment 7 
B=3 
^3 


Treatment 8 
8=3 
G=3 



*Times are approximate. 



Treatment 6 25% Higher Cognitive Questions 
Treatment 7 = 505^ Higher Cognitive Questions 
ireatment^8.=-75%.H1gher Cognitive Questions 
Treafnent 9 = Art Activity 
B = Boys ^ ^ 

G = Girls 183 



blocks due to logistical constraints. Since teachers formed car pools to 
drive to School District II, they were assigned to schools, and thus blocks, 
on the basis of the proximity of their residence to other teachers. 
Although not random in the usual sense, the arbitrary criterion of 
proximity to other teachers suggests that this procedure was unlikely 
to generate study-relatf^d bias in the assignment of ecology teachers to 
blocks. 

Assignment of Trea '^ ments to Ecology Teachers 

The same procedures used in Study I (see page 66) were followed 
to assign the twelve ecology teachers to the four Study II treatments. 
The basic procedure was that, after the teachers had been assigned to 
squares, they were randomly assigned to cells in their respective squares. 
The result was that each teacher conducted the four different treatments 
in the four classrooms during each school day. 

Assignment of Students to Treatments 

Discussion treatments with approximately equal numbers of boys and 
girls were desired. Thus, each class was stratified with respect to sex 
of students. Boys were randomly assigned to the discussion treatments 
until there were three boys in each treatment. The remaining boys were 
assigned to the art activity group. The same procedure was used to assign 
girls to treatments. 

Table 32 presents the results of this assignment procedure. Since each 
classroom had a different class size and sex distribution, the composition 
of the art activity groups across the twelve classrooms varied in size 
and in proportion of boys and girls. 
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As in Study I, the student's regular teachers were asked whether 
any of the treatment groups contained students who became highly dis- 
ruptive when placed in proximity to each other. Such students were 
reassigned to another treatment. As in Study I, the frequency of re- 
assignments was low, on the average of about one per classroom. 

STATISTICAL ANALYSIS 

Introduction 

The data collected in the Latin square design of Study II were 

examined by the sane analysis of variance methods used in Study I. 
As in the first study, Study II was planned to provide a comparison 
among four instructional treatments: 25% HCQ, 50% HCQ, 75% HCQ, and 
Art Activiuy. There was a total of 12 classrooms, four for each of 
the Latin squares, and thers were also 12 ecology teachei s, four assigned 
to each Latin square. 

The rationale for the unit of analysis, the use of univariate 
analysis of variance, planned comparisons, statistical adjustment 
procedures, and treatment of missing data are the same as in Study I. 
Therefore, the reader is referred to pages 67-74 for discussion of 

these topics. • 

The following sections are concerned with statistical adjustment 
procedures and post-hoc comparisons as they apply specifically to 
Study II. 
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Adjustment Procedures 

As in Study I, each dependent variable was examined for the possibility 
of adjusting for pre-experimental differences before performing the analysis 
of variance. Using adjusted scores provides assurance (beyond the assurance 
created by random assignment of students to treatments) that pretreatment 
differences do not contribute to posttreatment differences. Adjusted 
scores also have the benefit of increasing the precision of the analysis. 

The adjusting variables were selected according to the same procedures 
and criteria as in Study I (see pages 67-70). Table 33 presents the infor- 
mation used to choose adjusting variables for posttreatment variables and 
the pooled slope estimates for those posttreatment variables which were 
adjusted. 

After the adjusting variables had been .acted, the appropriate 
cell means were adjusted in the analysis of variance. 

Planned Comparisons 

Each dependent variable measured by the test battery administered 
to all students in Study II was examined for the main effect of overall 
treatment differences in the analysis of variance. In addition, several 
planned comparisons of specific treatments were examined: (a) 25% HCQ 
treatment versus 50% HCQ treatment; (b) 25% HCQ treatment .versus 75% HCQ 
treatment; (c) 50% HCQ treatment versus 75% HCQ treatment; and (d) the 
combined HCQ treatments versus Art Activity II. Where the main effect 
of instructional treatment is statistically significant, the planned 
comparisons will hoJ.p i v it je nature of these differences. Even 
where the overall treatment effect is not storistically significant, 
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TABLE 33 



Study II 

Surrenary of Statistics Used in Adjusting Posttreatment Variables 



DEPENDENT 
VARIABLE 


ADJUSTING 
VARIABLE 


F FOR PARALLELISM 
OF REGRESSION 


r 




Ecology Information Test: 
Intentional Scale II, Delayed 
25% Intentional Scale 11, 
Post 

25^£ Intentional Scale II* 
Delay 

Incidental Scale II, Post 
Incidental Scale II, Delay 


Total Readi na 
Total Reading 

Total Readina 

Total Reading 
Total Reading 


'^l ^ = 2.60 

1 .21 
1.03 

.25 

.92 
.68 


.42 
.50 

.39 

.53 
.50 


.0627 
.0603 

.0494 

.0861 
.0874 


Oral Test: 
Content Scale, Post 
Logical extension. Post 


Pre 
Pre 


.93 
1.37 


.44 
.62 


.3894 
.7922 


Essay Test: 
Content Scale,- Post 


Pre 


2.53 


.65 


.7002 


Transfer Test: 
Content Scale, Delay 


Essay conte.it. Pre 


.18 


.62 


.6174 


Written Question-Generating 
Test: 
Pertinent Questions 


Pre 


1.03 


.62 


.7519 


Word Association Scale: 
Wolf, Post 
Alligator, Post 


Pre 
Pre 


.54 
1.50 


.58 
.53 


.6080 
.5251 


Gall -Crown Discussion 

Attitude Scale: 
Thought, Post 
Discussion, Post 


Pre 
Pre 


1.16 
2.53 


.55 
.58 


.6731 
.7051 
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examining comparisons will provide information about the more specific 
effects of discussion treatments. 

Each comparison has one degree of freedom and was tested for sig- 
nificance using the mean square error term from the analysis of variance. 
For those dependent variables which were adjusted, these comparisons used 
adjusted cell means. 
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CHAPTER SIX 
STUDY II RESULTS 



The statistical analyses for Study II were planned in response to two 
research objectives: 

1. to determine what student learning outcomes were affected by 
variations in the percentage of higher cognitive questions 
in discussions; and 

2. to determine what student learning outcomes were affected by 
presence or absence of discussions. 

As discussed earlier, four instructional treatments were designed to investi 
gate these effects. In the 25% HCQ treatment, twelve groups of students 
participated in discussions in which 25 percent of the questions required 
a higher cognitive response (the other 75 percent required recall of 
information). In the 50% HCQ treatment, the percentage of higher cognitive 
questions was iTicreased to 50 percent. Another twelve groups of students 
participated in this treatment. In the 75% HCQ treatment, the percentage 
of higher cognitive questions was increased to 75 percent. Another 
twelve groups of students participated in this treatment. The ecology 
teachers were instructed to probe and redirect student responses to the 
specified questions in each treatment. In the art activity treatment, 
twelve jroups of students participated in curriculum-related art activities 
with no discussion. 

The treatments were administered within a Latin square design by 
twelve ecology teachers to twelve sixth-grade classes in the same school 
district. Eac^: student was administered a test battery before, immediately 
after, and/or two weeks after the treatments to determine the effects of 
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tjhe treatments on achievement and attitudes related to the specific 
cLi^ cijium which they had studied. 

The following discussion presents the results of the experiment. It 
is organized in the same sequence as in the Results Section for Study I. 
The st^tistico*^ tables also have the same format whenever possible. 

Pir^t, the data for each dependent variable were examined by analysis 
of variance methods to determine statistical significance ^pf the overall 
treatment effect. Grrjps within treatments rather than individual students 
were used as the unit of analysis. 

Next the planned comparisons of treatment means for each dependent 
variable were completed. The purpose of these comparisons was to determine 
the statistical significance of the specific differences between treatment 
nieans. .. The comparisons included: 

the difference between the 25% HCQ treatment means and 50% HCQ 
treatment means; 

(b) the difference between the 50% HCQ treatment means and the 75% 
HCQ treatment tneans; and 

(c) the difference between the 25% HCQ treatment means and the 75% 
HCQ treatment means. 

This analysis was designed to determine whether variations in percentage of 
higher cognitive questions in a discussion affected student learning outcomes. 

A fourth planned comparison was between the three combined discussion 
treatment neans and the art activity means. The purpose of this 
analysis was to determine whether presence or absence of discussions 
following initial reading/viewing of curriculum material affected student 
learning outcomes. 
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Following the planned comparisons, other effects examined by the analy 
of variance are discussed. These include: class, ecology teacher, Latin 
square, and treatment by Latin square interaction. 

As in Study L, the results are presented in three subsets for ease of 
interpretation. First, the achievement test data are discussed in terms 
of treatment main effects, planned comparisons of treatment means, and 
other analysis of variance effects. Next, the attitude scale data are 
discussed under the same headings. Finally, the status variables (verbal 
ability and session attendance) are discussed in the context of their 
possible influence on observed treatment differences. 

Cell means used in the analysis are reported in Appendix E of this 
volume. 

ACHIEVEMENT MEASURES 

Table 34 presents the results of the analysis of variance for the 
ability, achievement, and attendance measures which were administered in 
Study II. Interpretation of column labels can be found in the discussion 
of Table 16 in the Study I report (see pages 77-79). To summarize briefly, 
this table contains^ the following information: 

(a) the name of each dependent variable; 

(b) name of adjusting variable, if any; 

(c) the error mean square and its degrees of freedom; 

(d) the F-stati sties for each variable for the main effect of treat- 
ment, of class within squares, of teachers within squares, of 
squares, and the treatment by square interaction; and 

(e) the strength of association statistics associated with the 
column's effect for each variable. 
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Main Effect of Treatment 

Inspection of Table 34 in which results for the achievement measures 
are reported reveals that there were statistically significant differences 
at the 5 percent lovel between instructional treatment group means on the 
following variables: 

- Ecology Information Test Intentional Scale II (post and delayed) 

- Ecology Information Test ZS% Intentional Scale (post and delayed) 

- Ecology Information Test Incidental Scale^.II (post and delayed) 

- ^ ^ Test Content Scale (post) 

^ Test Logical Extension Scale (post), and 

- E^.^ay Test Content Scale (post). 

None of the variables derived from the Transfer Test or question-generating 

a Si.: res yielded a significant treatment effect. It is interesting to 
note, based upon these results, that the treatments seem to have had more 
influence upon recall of information than upon the various higher level 
outcomes. For example, all the information test subscales emphasize 
factual knowledge and the content scales of the oral and essay tests, 
while requiring higher cognitive responses, build these responses from 
the actual content of the questions asked during the discussions. Further, 
the lack of differences in the oral question generating tests and the 
relatively low scores achieved by the students on all but the pertinent 
question subscale of these rieasL:res (see Appendix E for cell means) suqgest 
that students were having some difficulty moving beyond the actual content 
of the curriculum and the discussion questions. Planned comparisons to 
determine which of the treatment means differed significarjitly from each 
otiier on these achievement variables are presented in the next section. 
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TABLE 34 
Study II 

Analysis of Variance Sumar.y for 
Heasures of Ability, Achievement, and Attendance 



F VALUES AND oi^ FOR ANALYSIS OF VARIANCE EFFECTS 



DEPENDENT VARIABLE 


ADJUSTING 
VARIABI F 


HSerror 


Treatment 


Class 


Teacher 


Square 


Treatment 
bv Square 


3,18 




F 

9,18 




F 

9,18 




F 

2,18 




F 

6,18 




STATUS VARIABLES 

Number of Sessions Attended 




0.51 


0.18 


0.00^ 


0.46 


0.00 


0.96 


0.00 


1.49 


0.02 


1.11 


0.01 


CTBS'J - Total Reading 




48.25 


0.53 


0.00 


1.38 


0.02 


0.82 


0.00 


0.93 


0,00 


1.01 


0.00 


KNOWLEDGE VARIABLES 
Ecology Unformation Test: 
Intentional Scale II, post 




0.33 


8.55* 


0.31 


1.42 


0.05 


1.08 


0.01 


0.72 


0.00 


■ 0.69 


0.00 


Intentional Scale II, delay 


total rdng. 


0.40 


l2.5l* 


M' 


0:77 


0.00 


0.92 


0.00 


3.S5* 


0.07 


0.54 


0.00 


25J Intentional Scale II, post 


total rdng. 


0.3S 


9.46* 


O.40 


1.00 


0.00 


"O.S( 


0.00 


0.48 


0.00 


0.28 


0.00 


M Intentional Scale II, delay 


total rdng, 


0.49 


5.20* 


0.25 


1.^5 


0.04 


0.42 


0.00 


0.54 


0.00 


0.73 


0.00 


Incidental Scale II, post 


total rdng. 


0.48 


7.49* 


0.27 


1.60 


0.07 


0.88 


0.00 


2.37 


0.04 


1.57 


0.05 


Incidental Scale II, delay 


total rdng. 


0.58 '■ 


7.35* 


"0.28 


'1.'37 


"0.05 


0.49 


0.00 


1.86 


0.03 


0.90 


0.00 


HIGHER COGNITIVE VARIABLES 

Ural icbii 

Content, post 


pre 


1.10 




0 19 


0 4? 


0 00 


0 73 


0 00 


9 88* 


0 25 


2 12 

b* IL 


0 15 


Logial Extension^ post 


pre 


0.68 


4 01* 






(i 25 


1 1? 

1*17 


n 02 


3 22 

Jl Lb 


0 05 


1 42 


0 03 


Essay test: 

fnntont nnct 


pre 


1 IQ 

1.13 


8.15* 


0.14 


9.77* 


0.52 


1.35 


0.02 


1.57 


0.01 


0.97 


0.00 
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b.O)' 


2.r 


U1 


0.35 


O.OO 


0.l5 


O.OO 


0.34 


0.00 


Content, delay 


Ess.Cont.pre 


2.29 


0.32 


0.00 


1.75 


0.15 


0.34 


0.00 


1.78 


0.04 


0.58 


0.00 


Logical Extension, delay 




0.39 


0.64 


.0.00 


3.33* 


0.32 


1.24 


0.03 


1.03 


0.00 


0.38 


0.00 


QUESTION GENERATING VARIABLES 
Written Question Generating Test; 
Non-pertinent Questions 




0.16 


1.08 


0.00 


1.41 


0.07 


0.77 


0.00 


2.29 


0.05 


0.74 


0.00 


PprtTnent Questions 


ore 


3.52 


2.81 


rQ.'o4 ■ 


7.6> 


0.43 


1.33 


0.02 


15.10* 


0.20 


0.33 


0.00 


Specific Questions 




1.S3 


2.66 


Q.07 


3.9S* 


0.36 


o.'4o 


0.00 


0.50 


0.00 


1.02 


0.00 


Request for Rationale 




0.18 


0.37 


0.00, 


0.61 


0.13 


0.65 


0.00 


0.27 


0.00 


0.21 


0.00 


Quality Rating 




0.06 


0.51 


0.00 


1.75 


0.14 


0.90 


0.00 


0.83 


0.00 


0.36 


0.00 


Oral Question Generating Test; 
Iwn-pertinent Questions 




0.03 


1.23 


0.00 


1.61 


0.05 


0.98 


0.00 


3.86* 


0.08 


1.41 


0.32 


Pertinent Questions 




0.45 


0.61 


1.00 


0.66 


0.00 


0.98 


0.00 


0.49 


0.00 


1.22 


0.03 


Quality Rating 




0.07 


0.12 


0.00 


1.24 


0.05 


0.47 


0.00 


3.35 


0.11 


0.32 


0.00 



♦Significance at the .05 level. The .05 levels for F values with the following degrees of freedom are: 

■I-*-, ,„=3.55 F,,=3.15 F^, =2.65 F„ =2.45 
2,18 3,18 6,18 9,18 

V = proportion of total variance explained (omega squared). 

''CT6S= Comprehensive Tests of Basic Skills. 



139 



Omega squared values for the effect of treatment range from .00 to .42 
with seven values exceeding .15. It is noteworthy that the omega squared 
values for treatment associated with the knowledge variables (Ecology 
Information Test) are quite large. In the other variable categories, 
the low omega squared values further suggest that the effect of the treat- 
ments in Study II on higher cognitive response skills and question generating 
skil 1 was smal 1 . 

Planned Comparisons of Treatment Means 

Table 35 presents the planned comparisons of treatment means. The 
table lists each of the status and achievement test variables in the first 
column. The next four columns present all means for each treatment in 
the Latin square design: 25% HCQ, 50% HCQ, 75% HCQ, and Art Activity, 
respectively. For variables which were adjusted before entry into the 
analysis of variance, the values shown in these columns are adjusted 
means. A eference number in parentheses associated with each treatment 
is used in labeling the columns for planned comparisons. 

The next four columns present F-statistics for the planned comparisons 
of treatment group means or adjusted means. The first of these columns 
compares the 25% HCQ treatment with the 50% HCQ treatment (1 vs. 2); the 
second column compares the 50% HCQ treatment with the 75% HCQ treatment 
(2 vs. 3); and the third column compares the 25% HCQ treatment with the 
75% HCQ treatment (1 vs. 3). The fourth column compares the average 
effect of the three discussion treatments with the no-discussion art 
activity treatment. 

Tp the column labeled "Prop," the ratio of sum of squares for the 
contrast to sum of squares for the main effect of treatments is presented. 
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TABLE 35 



STUDY II 

Treatnent Means and Planned Comparisons of 
ileasures of Ability, Achievenent, and Attendance 



DEPEHDEUT 
VARIABLE 


ADJUSTING 
VARIABLE 


TREATMENT MEANS 


PLANNED COMPARISONS 


25^ HCQ 
Treat- 
ment 


50^ HCQ 
Treat- 
,lifint . 


75% HCQ 
Treat- 
ment 


Art 
Activ. 
II 


Treat- 
ments 
1 YS 2 


Treat- 
ments 
2 vs 3 


TrP3t- 
ments 
1 vs 3 


Treatments 

LL2 vs 4 


(1) 


(2) 






F. 

1,18 


F 

1,18 


F 

1,18 


F 

1,18 


a 

Prop. 


CTflTnC \f Ant flhi rr 

blATUb VARIABLES 

iiuiiiucr ui jcbbiunb rtiicnuca 




9.23 


9.04 


9.17 


9.21 


0.45 


0.19 


0.05 


U.U/ 


U. \i 


wiDO^ ^ IULhI tACuUlfiU 





51.59 


64.71 


61.85 


63.63 


1.13 


1.10 


0.00 


0 Id 




Ecology Information Test: 
Intentional Scale II, post 




6.27 


5.94 


6.29 


5.26 


2.01 


2 21 


0.00 


22.83* 


0.89 


Intentional Scale II. delav 




6.19 


5.26 


5.85 


4.74 


13.12* 


5.31* 


1.73 


24.10* 


0.48 


25ii Intentional Scale 11, post. 


Jotal rdnq. 




J i 00 


d m 

Ti U 1 


J. Dl 


ILL. 70 


^ Q7 
0.7/ 


7 Sl"^ 
/ .Oj^ 


5.21* 


0.18 


25* Intentional Scale II, delay 


total rdng. 






Ji /o 


J. 30 


n cot 




7 in* 


2.67 


0.47 


Incidental Scale IT nnst 




5.97 


4.92 


5.83 


5.00 


13.66* 


10.29* 


0.24 


5.34* 


0.28 


Incidental Scale II, delay 


total rdnq, 


5.91 


4.52 ' 


5 34 


4 67 


17 22* 

1 / . Li, 


5 97* 

J.J/ 


? ql 


4.49* 


0.21 


HIGHER COGHITIVE VARIABLES 
Oral Test: 
Content, post 


pre 


8.88 


8.83 


8.42 


7J5 


0.01 


0.96 


1.17 


15.15* 


0.91 


Logical Extension, post 


pre 


4.03 


3.80 


3.10 


2.95 


0.50 


4.30 


7.7? 




n 4^ 

Ui to 


Essay Test: 
Content, post 


ore 


11 58 


12 55 


11 fid 


10 ifi 


*f. 10 


4.11 


n n? 

U.Ul 


18.54* 


0.76 


LoQical Extension. DOSt 


- 


2 11 
bill 


2 30 




1 fifi 
1 .00 


1 U 


U.Ql 


u.u4 


2.89 


0.81 


Tr/^n?fpr Tpct» 

1 1 Qlld 1 CI 1 1 1 

Content, delav 




8.79 


8,99 


8.62 


8.40 


fl.lO 


0.07 


0.61 


0.61 


0.64 


LUUiLdi LAuciiJiun) Qciay 




1 67 


1 73 


1 85 


1 51 


0 07 


0 ?? 


n 

u. OJ 


1.37 


0.72 


•lUESTION-GENERARING VARIABLE 
Written Question Generating Test: 
Non-pertinent Questions 




0.37 


0,43 


0.61 


0.34 


0.11 


1.28 


2.15 


0.86 


0.27 


Pertinent Questions 


pre 


12.48 


13.51 


12.52 


11.29 


1.60 


1.68 


0.00 


6.12* 


0.73 


Specific Questions 




3.24 


4.16 


3.12 


2.81 


3.36 


4.25 


0.05 


2.87 


0.36 


Request for Rationale 




0.56 


0.51 


0.42 


0.39 


0.08 


0.29 


0.65 


0.42 


0.38 


Quality Rating 




IM 


2.98 


2.86 


2.54 


Q.21 


].4S 


dM 


0.02 


0.01 


Oral Question Generating Test: 
Non-pertinent Questions 




0.18 


0.11 


0.14 


0.14 


3.49 


1.1/ 


0.62 


0.17 


0,05 


Pertinent Questions 




1.85 


1.87 


1.55 


1.64 


0.00 


1.25 


1.11 


0.27 


0.15 


(Quality Rating 




l.OC 


1.10 


1.05 


1.02 


0.07 


0.19 1 0.03 


0.17 


0.46 



♦Significance at the .05 level. The .05 level for F values with 18 degrees of freedooi is: 
F = 4.41 
1,18 

3prop. = Sum of squares for Treatments 1, 2, 3 vs 4 as a proportion of total treatment suoi of squares. 
^CTBS = Comprehensive Tests of Basic Skills. 
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Additional details about the construction of this table are presented 
in the discussion of the corresponding Table (17) in. the Study I report, 
on page 81 . 

The planned comparisons of treatment means show that percentage of 
higher cognitive questions was a statistically significant influence on 
the amount of information acquired by students as measured by subscales 
on the Ecology Information Test. The pattern of treatment mean scores 
is depicted in Figure 2. It appears that a U curve describes the relation 
between percentage of higher cognitive questions and achievement on 
intentional and incidental scales of the Ecology Information Test. In 
all cases, the 50% HCQ treatment had considerably lower outcomes on the 
subscales of the Ecology Information Test than the other two discussion 
treatments. The 75% HCQ and 25% HCQ treatment outcomes fell at similar 
points for the various subtests. Outcomes for the art activity treatment 
approximated those for the 50% HCQ. 

Since this finding was somewhat unexpected--a gradual increase in out- 
comes moving from the art activity to 25% HCQ, to 50% HCQ, with 75% being 
highest was expected--a secondary analysis of the data has been requested. 
This analysis is being conducted by Dr. Richard Snow, Stanford University. 
The purpose of the secondary analysis is to identify possible explanations 
for the U curve in order to aid in interpreting and applying the results 
of Study II. The report of the secondary analysis will be presented in a 
separate document. 

Overall, the effects of treatment variations in Study II were non- 
significant for the other higher cognitive achievement measures. The only 
exceptions to this observation are that the 25% HCQ treatment groups 
achieved statistically greater Oral Test Logical Extension scor i relative 




FIGURE 2 

Patterns of Treatmpnt Differences for 
Ecoloqy Information Subtests in Study II 



LEGEND 

Intentional Scale II (post) 
Intentional Scale II (delay) 
25% Intentional Scale II post) 
25% Intentional Scale II (delay) 
Incidental Scale (post) 
Incidental Scale (delay) 




25% Higher 

Cognitive 

Questions 



50% Higher 

Cognitive 

Questions 



75% Higher 

Cognitive 

Questions 



Art Activity 
II 



*Data Doints on the graph are based on unadjusted treatment means. The 

tSree ^acftat^on treatment means are expressed on the °r inate as abso ute 
deviations from the art activity treatment means. The latter means serve 
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to the 75% HCQ treatment groups; and that the 50% HCQ treatment grouns 
achieved statistically greater Essay Test Content scores than did the 255^ 
HCQ treatment groups. 

These results relate to the Study II objective of determinir^g what 
student learning outcomes are affected by variation in the percentage of 
higher cognitive questions in discussions. The results indicate that 
variation in the percentage of higher cognitive questions gener a lly does 
not influence higher cognitive response ability or guestion-genr^rating 
ability. However^ variation does have an effect on knowledge acquisition 
such that low or high percentages of higher cognitive questions are more 
effective than a moderate per centage of the^e questions. 

- — - — ■ • ' ' V, 

The planned comparisons of the average of the three discussion treat- 
ment means on each achievement variable with the respective art activity 
treatment mean revealed that students in the discussion treatments had 
statistically superior achievement on the following measures: 

- Ecology Information Test Intentional Scale II (post and delayed) 

- Ecology Information Test 25% Intentional Scale (post) 
Ecology Information Test Incidental Scale II (post and delayed) 

- Oral Test Content (post) 

- Logical Extension (post) 

- Essay Test Content (post) 

- Written Question-Generating Test Pertinent Questions (post). 

The proportion of total between treatment variablity accounted for by the 
comparison of the higher cognitive questions treatments to Art Activity 
was moderate, ranging from .01 for the quality rating on the Written 
Question-Generating Test to .91 on the adjusted posttest score on the 
Content Scale of the Oral Test. Six of the 20 comparisons had a ratio 
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greater than or equal to .65. Given the findings relative to the 50% HCQ 
treatment, it can be surmised that the majority of these differences may 
be attributed to the effects of the 75% HCQ and 25% HCQ treatments. As 
v;ould be expected given the over-all treatment findings, the preponderance 
of differences were on those measures related to recall of information 
(the information tests and/or higher cognitive outcomes building from 
the content of the discussions and/or the curriculum). Study II discussions 
appear to help students remember curricular content better than when they 
merely read and/or hear about it. 

These results relate to the research objective of determining which 
student learning objectives are affected by presence or absence of discus- 
ion. The results indicate that discussion of the type incorporated in 
the three Study II discussion treatments is more effective than a competing 
no-discuss^on treatment in facilitating knowledge acquisition and ability 
to respond to higher cognitive questions that build from the content of the 
curriculum both orally and in written form. 

Classroom, Teacher, and Square Effects 

Unlike Study I, there were few instances in which the analysis of 
variance effects for class, teacher, square and treatment by square were 
statistically significant, as presented in Table 34. Omega squared values 
were consistently small, ranging from .00 to .52 with only ten of the 
120 statistics exceeding .15, of which six were associated with class 
effects. With the possible exception of the class effects for the 
achievement variables of Oral Test Logical Extension (post). Essay Test 
Content (post) and Logical Extension (post). Transfer Test Logical Extension 
(delay), and Written Question-Generating Test Pertinent Questions (post) 
and Specific Questions (post), these differences appear sporadic and of 
little value in interpreting the results of the study. 
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ATTITUDE MEASURES 

Table 36 presents the results of the analysis of variance for scales 
derived from the following attitude measures: Word Association Scale, 
Gall -Crown Discussion Attitude Scale, Ecology Unit Opinions Scale, and 
Ecology Discussion Attitude Scale,* 

The table is organized according to the same format as the preceding 
table. Details about the table's construction and labels are presented on 
pages 91 - 93 of the Study I report. 

Main Effect of Treatment 

Table 36 indicates that the overall treatment effect was statistically 
significant for only two attitude scales (Wolf and All"^gator scales of the 
Word Association Scale), Because of the large number of comparisons (14), 
approximately one difference would be expected to occur by chance alone 
rather than reflect a true difference between means. 

Planned Comparisons 

Planned comparisons involving the differential effect of treatments 
on attitude scales are presented in Table 37. This table is organized 
according to the same format as Table 34, which presents planned comparisons 
involving the achievc.'nent variables of Study II. Details about the con- 
struction and labeM'ng of this table are presented in the Study I report 
on pages 

* Analysis of variance for the two subscales derived from the Ecology 
Discussion Attitude Scale included only the three discussion treatments. 
This measure was not administered to students in the art activity treat- 
ment since they did not participate in ecology discussions. 
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TABLE 36 
Study II 

Analysis of Variance of Attitude Scale Scores 



DEPENDENT 
VARIABLE 


ADJUSTING 
VARIABLE 


MSerror 
df=18 


F VALUES AND FOR ANALYSIS OF VARIANCE EFFECTS 


Treatment 


Class 


Teacher 


Square 


Treatment 
by Square 


F 

3,18 




F 

9,18 




F 

9,18 




2,18 




F~ 
6,18 




.CORRICULUM-RELATED VARIABLES 
Word Association Scale 
Ecology 




30.97 


0.48 


0.00^ 


1.14 


0.03 


0.80 


0.00 


1.17 


0.00 


0.79 


0.00 


Balance of Nature • 




16.51 


1.94 


0.05 


0.96 


0.00 


0.79 


0.00 


0.39 


0.00 


1.87 


0.09 


Wolf 

If W 1 1 


pre 


10.13 


D.JO 


U.6J 


n (iR 

U. 09 


n nn 




n (17 


U.Ov 


n on 


1 fi4 




Air Pollution 




6.51 


n /in 

0.48 


0.00 


A 1^ 

0.34 


A AA 

0.00 




U.UU 


1 no 


n nn 
U.UU 


n C7 
U.o/ 


n nn 
U.UU 


Alligator 


pre 


10.6^ 


7.4()* 


o:27' 


1.84 


O.lO 


0.65 


0.00 


0.19 


0.00 


0.8] 


0.00 


Water Pollution 




6,/6 


0.53 


0.00 


0.72 


0.00 


0.75 


0.00 


4.21* 


0.12 


1.44 


0.05 


DISCUSSION VARIABLES 
Gall-Crown Dis. Attitude Scale: 
Att.toward Thought Questions 


pre 


4.54 


1.38 


0.02 


0.54 


0.00 


0.95 


0.00 


1.26 


0.01 


2.24 


0.14 


Attitude toward Discussion 


pre 


22.44 


O.DO 


O.UU 






n /IK 


0 nn 


1 9Q 


n Tm 


1 . 10 


n no 


GENERAL TREATMENT VARIABLES 
Ecology Unit Opinions Scale: 
Attitude toward Peers 




i.69 


2.55 


0.08 


1.04 


0.00 


0.64 


0.00 


0.37 


0.00 


1.63 


0.07 


nllllUUC lUriClIU iCuUilCI 




10.88 


0.21 


o'.oo 


0.61" 


0.00 


1.46 


0.08 


1.24 


0.01 


1.07 


G.OO 


Attitude toward Curriculum 




5.^7 


0.29 


o.do 


^0.53 


0.00, 


1.35 


0.06 


3.49 


O.lO 


0.43 


0.00 


TREATMENT-SPECIFIC VARIABLES 
Ecology Discussion Attitude Scale 
Att.toward Thought Questions 




14.74 


0.04 


0.00 


0.78 


0.00 


0.64 


0.00 


0.67 


0.00 


0.15 


0.00 


Attitude toward Discussion 


GDAS.pre-dsc 


19.71 


O.ll 


0.00 


0.64 


0.00 


1.15 


0.02 


7.67* 


0.28 


0.48 


0.00 


Ecology Art Project Scale 
Attitude toward Art Projects 



























*Significance at the .05 level. The .05 level for F values with the following degrees of freedom are: 

f2,18=^'^= W W-"" W 
y = proportion of total variance explained (omega squared). 

{Jl 
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Planned comparisons of discussion treatment means on the attitude 
measures are significant only for the Alligator scale. The mean of the 
75% HCQ treatment groups was significantly greater than the mean of the 
50% HCQ treatment groups. This is one of the dependent variables which 
showed an overall treatment effecu in the analysis presented directly 
above. However, in view of the large number of planned comparison., 
this difference is quite likely a chance result. 

These results relate to one of the research objectives of Study II; 
that is, to determine which student learning outcomes are affected by 
variation in the proportion of higher cognitive questions in discussions. 
The results indicate that variation in percentage of higher cognitive 
quesilnns does not affect student attitudes toward curriculum-related 
topics, c r^war;^ discussions in general , o r toward the specific learning 
experiences wh ich these variations were tested. 

The planned Tomparisons of the average of the three discussion treat- 
ments versus 1''.e art activity treatment revealed significant differences 
for the same two scales (Wolf and Alligator) as in the preceding analysis. 
Students in the discussion treatments expressed significantly more positive 
attitudes toward alligators and wolves than did students in the art 
activity treatment. It should be noted that each of the discussion treat- 
ments had slightly higher means than the art activity treatment on two other 
of the six scales included in the Word Association Scale, although the 
differences were not statistically significant. One subscale of the 
Ecology Unit Opinions Scale (Attitude toward Peers) also revealed a 
significant difference favoring the discussion treatments. 

As noted in the presentation of Study I results (see page 95), the 
mean scores of the different treatment-specific attitude scales cannot be 
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TABLE 37 
Study II 

Treatment Means and Planned Comparisons of 
Attitude Measures 



DEPENDENT 

I/AOTADI c 

VARlABLt 


N n 11 IPTT II A 

ADJUSTING 
vARIAdLl 


TREATMENT MEANS 


PLANNED COMPARISONS 


25^ HCQ, 
Treat" 


50^ m 

Treat- 


M m 

Treat- 


Art 
Activ. 


Treat- 
ments 
,L„YS 2 


Treat- 
ments 
2 is 3, 


Treat- 
ments 
1 vs 3 


Treatments 
1,2.3 YS4. 


(1) 


(2) 


(3) 


(4) 


p 

1,18 


p 

1,18 


p 

1,18 


F 

1,18 


Prop, 


CURRICULUM RELATED VARIABLES 
Word Association Scale; 
Ecology 




CO ^0 


bJ.UI 


CH CI 

54.31 




U.UO 






0.59 


0.41 


Balance of Nature 




59,73 


59.40 


61.41 


57.93 


0.04 


1.48 


1.02 


4.12 


0.71 


Wolf 


pre 


57.48 


55.74 


57.57 


52.62 


1.81 


1.98 


0.00 


16.46* 


0.87 


Air Pollution 




60.21 


59.22 


59.59 


60.27 


0.91 


0.13 


0.35 


0.51 


0.35 


Alligator 


pre 


51.65 


49.42 


54.61 


46.86 


= '2.82 


5.74* 


0.51 


16.15* 


0.73 


Water Pollution 




59.91 


58.59 


59.07 


59,15 


1.55 


,0.21 


0.62 


0 00 


0 00 


DISCUSSION VARIABLES 
Gall-Crown Dis. Attitude Scale: 
Att. toward Thought Questions 


pre 


30.33 


29.91 


30.83 


29.13 


0.23 


1.13 


0.34 


3 00 


0 73 


Attitude toward Discussion 


pre 


56.14, 


55.69 


54.17 


53.92 


0.05 


0.62 


1.04 


0.80 


0.41 


GENERAL TREATMENT VARIABLES 
Ecology Unit Opinions Scale: 
Attitude toward Peers 




16.87 


17.12 


17.06 


15.83 


0.21 


0.01 


0.12 


7.44* 


0.97 


Attitude toward Teacher 




58.09 


58.09 


57.70 


57.16 


0.00 


0.08 


0.08 


0.53 


0.83 
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TREATMENT SPECIFIC VARIABLES 
Ecology Discussion Attitude Scale 
Att. toward Thought Questions 
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Ecology Art Project Scale: 
Attitude toward Art Projects 










63.36 














*Significance at the .05 level. The .05 level for F values with 18 degrees of freedom is: 1,18 



*?rop. = Sum of squares for Treatments 1,2,3 vs 4 as a proportion of total t*eatment sum of squares S 
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compared directly, since they incorporate different items and are of dif- 
ferent lengths. However, a rough comparison of results can be made by 
computing the students' average rating per item, derived by dividing the 
group's total score by the number of items in the scale. The students in 
the discussion treatments completed the Ecology Discussion Attitude Scale. 
Their average rating per item on the Attitude toward Thought Questions sub- 
scale was 3.00, and on the Attitude toward Discussion subscale it was 3.15. 
The students in the art activity treatment completed the Ecology Art Project 
Scale, on which they gave an average rating per item of 3.33. Assuming 
equivalence of ratings in the two scales, it appears that students had 
slightly more positive attitudes toward the art activity treatment than 
their peers had toward the discussion treatments. 

These results relate 1. - research objective of determining which 
student learning outcomes are affected by presence or absence of discussions. 
The results indicate that discussion of the type incorp orated in the three 
discussion treatments in Study II may be slight ly more effective than a 
competing no-discussion treatment in promoting positive st udent attitudes 
toward curriculum-related topics; however, students may perceive the 
experience of art activity slightly more favorably than they perceive 
discussion experiences. 

Classroom, Teacher, and Square Effects 

Even fewer of the analysis of variance effects for class, teacher, 
square, and treatment by square were statistically significant for the 
affective measures than for the achievement measures in Study II. The 
only significant effects were found for squares in the Water Pollution 
Scale and the Attitude toward Discussion Subscale of the Ecology 
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Discussion Attituci^^ Scale. However, based on the number of analyses com- 
pleted, these results can be accounted for by chance and contribute little 
to the interpretation 'T)f treatment effects. 

STATUS VARIABLES 

To test the possibility that differences obtained for post and delay 
variables were reflections of pre-existing differences in the sampled students 
rather than the result of experimental conditions, analyses of variance were 
performed on the total reading score and on the average number of lessons 
attended by students within a grou^\ The results of these analyses were 
presented in Table 34. Uo statistically significant effects were observed 
for either variable. The omega squared values for analysis of variance 
effects were never greater than .02. Also, inspection of Table 35 indicates 
that the actual treatment means for these two variables fell within a 
relatively narrow range of values. 

It can be concluded that neither general academic aptitude as measured 
by total reading ability nor differential absenteeism from instructional 
lessons were influential in producing differences in the study. 

SUMMARY 

The results of Study II can be summarized by referring to the two 
research objectives which guided the research. 

1, The first objective was to determine which student learning out- 
comes were affected by variations in the percentage of higher cognitive 
questions in discussions. The results of the data analysis for Study II 
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indicated that differences in percentage of higher cognitive questions 
affected students' acquisition of knowledge and higher cognitive response 
ability, both oral and written. Further, low or high percentages of 
higher cognitive questions were more effec.'ve than moderate percentages 
of these question;-, in building students' recall of information about a 
specified curriculum. 

Variations in percentage of higher cognitive questions in discussions 
appeared to have little effect upon students' attitudes toward the curri- 
culum content or the learning situation. 

2. The second research objective was to determine which student 
learning outcomes were affected by presence or absence of discussion. 
The results of Study II indicated that discussions were more effective 
than a competing instructional method (art activity) in facilitating know- 
ledge acquisition and ability to respond to higher cognitive questions in 
oral and written form. They also may be slightly more effective in pro- 
moting positive student attitudes toward curriculum-related topics. How- 
ever, the art activity method may be perceived as a slightly more positive 
instructional situation than the discussion method. 
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CHAPTER SEVEN 
DISCUSSION OF FINDINGS 



Because both Study I and Study II investigated the effectiveness of 
teacher use of questioning techniques, the following discussion takes into 
consideration the results of both studies. In this way, the implications 
of the research findings in each study for the field of teaching and 
teacher training can be considered from a broader perspective. 

The discussion covers six major topics. The first topic i: a rev* 
of the research procedures and aprilytis of the advantages of these pro- 
cedures comp.^red to previous itier:hodoiogy in research on teaching. The 
second topic concerns the limitations of the research design in both 
studies. The third relates to the major research questions posed by the 
studies—the effects of questioning techniques upon students' achievement 
and attitudes. The fourth topic deals with secondary areas of interest 
such as compari'^on of students' oral and written responses, comparison of 
intentional and incidental learning effects, and possible competing 
hypotheses in the studies. The fifth topic concerns the findings as they 
relate to Minicourses 1 and 9, the teacher training products from which 
the teaching strategies that were investigated in the studies were derived 
(see Appendix A for the Minicourse objectives and skills). The final 
topic presents the implications of the findings for educational research 
in general, and for research on teaching in particular. 
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STRENGTHS OF RESEARCH DESIGN 

Several recent reviews have criticized the technical quality of 
educational research and of research on teaching (e.g.. Heath & Nielson, 
1972 and 1974). Other reviews have suggested new approaches to research 
and how existing approaches could be applied more effectively (e.g., 
Cronbach, 1975). In both Study I and Study II, a concerted effort was 
made to reduce or eliminate eight research flaws identified in these 
reviews. These included one problem related to the assignment of students 
to treatments; one problem related to the appropriateness of student out- 
come measures; two problems related to "opportunity to learn"; two problems 
related to fidelity of treatment; and two problems related to statistical 
procedures. Consequently, the findings of Study I and Study II may be 
taken more seriously than those from the earlier studies and the impli- 
cations for f'iture research that are derived merit thoughtful consideration. 

Assignment of Students 

The majority of previous investigations of teacher questioning 
(reviewed by Rosenshine & Furst, 1971) assigned intact classrooms to 
treatments. Therefore, random assignment of students to treatment was 
limited by the extent to which a particular classroom represented a random 
sample of the student population. The validity of such an assumption is 
questionable. Based upon the classroom effects reported in Studies I 
and II, nonrandomness appears to be the more likely circumstance in 
intact classrooms. 
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The research designs for Study I and II solved the problem of specifying 
random assignment of students from each classroom to each treatment condition 
This assignment procedure, coupled with the use in each study of twelve class- 
rooins--two from each of six schools, increases the general izabil ity of the 
research results. It also increases the likelihood that the findings reflect 
treatment effects rather than pre-existing classroom differences. 

Student Outcomes 

Another research problem that received attention in Studies I and II was 
the extent to wliich the student outcomes measured in each study matched the 
instructional objectives of the treatment conditions. Several previous 
studies of the use of higher cognitive questions limited student outcome 
measures to paper-and-pencil fact recall tests (e.g., Wright & Nuthall, 
1970). Similar tests were used in Study I and Study II, but they were 
supplemented by tests of students' higher cognitive response ability in 
both written and oral format and by tests of intentional (included in the 
treatment curriculum) and incidental (not included in the curriculum) 
information recall. These tests measured learning outcomes which the 
discussion treatments were specifically designed to affect. 

Opportunity to Learn 

Two conditions related to "opportunity to learn" were controlled 

more effectively in Studies I and II than in most previous research. 

Time on task and opportunity to learn the posttest content were equated 
across the different treatment conditions. 

In Study I the filler activity and art activity treatments were 

designed to control and study the effects of time on task. In Study II 
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the 25% and "50% HCQ treatments included filler activity so that time on 
task was controlled across these two treatments and the 75% HCQ treatment. 
The art activity treatment also had the same time specification as the 
HCQ treatments. It should be noted, however, that the filler activities 
used to control time on task in certain of the discussion treatments also 
should be considered as treatment variables inasmuch as they introduced 
additional learning experiences. Thus, they did not provide as pure a 
time control as might have been desired. 

Opportunity to learn posttest content was controlled through (a) 
the specially-developed ecology curriculum, (b) the semi -programmed 
approach to the discussion treatments, and (c) the use of exemplary 
responses by the teacher if no student provided an adequate response 
during the discussion. As a result, much more is known about the actual 
instructional experience of students in Study I and Study II than in 
previous studies of teacher questioning. While careful control of oppor- 
tunity to learn has many advantages, it also may have introduced a state 
of affairs that typically does not exist in the classroom— in fact, one 
can almost assume that such is the case. Such careful presentation of 
curricular content and sequencing of learning probably does not occur on 
a regular basis in most classroom discussions. The control of treatment 
conditions, therefore, may have created a learning situation in which the 
effects of the teaching skills, as they would be observed in regular 
discussions, were masked by the effects of the "ideal" instructional 
situation. This issue is of particular importance in Study I where use 
of probing and redirection showed no added effects upon student outcomes 
beyond the use of discussion, per se, in these carefully controlled treatments. 
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T reatment Conditions 

In both Studies I and II treatments were defined and field-tested 
prior to initiation of the main research. During the studies, each treat- 
ment was monitored to assure maintenance of treatment conditions. The 
fidelity of treatment information presented earlier in this report indi- 
cates that the treatment conditions were maintained. 

Teacher by treatment interactions represent a factor that may reduce the 
fidelity of the treatment and, therefore, obscure treatment effects. Studies 
I and II controlled for this problem in three ways. First, special ecology 
teachers were employed and trained to use the semi-programmed discussion 
treatments. Second, each teacher was randomly assigned to teach each treat- 
ment. Third, tape recordings of each teacher's conduct of two of the nine 
curriculum lessons were analyzed for each of the discussion treatments. 
Teacher use of treatment-specific and other strategies that the researchers 
considered important to the learning situation were scored. 

The lack of teacher effects in Studies I and II indicates that these 
three measures controlled for teacher by treatment interactions. There- 
fore, it can be assumed that the treatment conditions in these studies 
were maintained at a much more exact level than in previous research. 
At the same time, the research was conducted in the regular school setting. 
As Snow (1974) observed, achieving treatment stability in a regular 
school setting is a matter of substantial importance. Studies I and II 
provide some insight into the strengths and weaknesses of one approach to 
the resolution of this problem. 

Statistical Procedures 

The final methodological problem to which Studies I and II responded 
concerns the critical assumptions underlying the statistical procedures 



used in analyses of data. Tests of the assumptions underlying adjustment 
of posttest scores were carried out in both of the s.^.udies. Whenever 
assumptions were not satisfied, the posttest scores v/ere not adjusted. 

As a result of the steps taken to resolve the eight problems cited 
above, the research in both Study I and Study II has made considerable 
progress in demonstrating that school -based research can be conducted 
with a high degree experimental control. In effect, these studies 
used the school as a laboratory, maintaining the students in their natural 
settinc; (with the accompanying advantages) while imposing strict fidelity 
of treatment controls. Also, random assignment of students to treatment 
was achieved. Therefore, the findings of Study I and Study II warrant 
careful review both for their implications concerning the effectiveness 
of questioning techniques and for their implications concerning future 
research on teaching. 

On the other hand, the use of a highly controlled experimental design 
limits the generalizability of the findings of the studies. The extent of 
these limitations is discussed in the following section. 

LIMITATIONS OF RESEARCH DESIGN 

Several of the limitations of research designs previously noted by 
Campbell & Stanley (1963) such as nonrandom assignment, differential 
mortality, maturation effects, and lack of fidelity of treatments were 
avoided in the two studies reported here. However, even though students 
were randomly assigned to treatments within the constraints of using 
intact classrooms as the sampling pool, there were substantial and 
systematic differences in the total reading scores of students assigned 
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to the different treatments in Study I. Although these differences were 
not statistically significant, they complicate the interpretation of the 
Study I results. 

Because of the sampling procedures used in the studies, contamination 
of treatments also is a potential problem. Even though random assignment 
of students from an intact classroom to all treatments strengthened the 
experiment in one respect, the presence of all the treatments in the class- 
room may have encouraged students in different treatments to discuss their 
training experiences and trade information and ideas about the curriculum 
with other students. Students were reminded several times during each 
study not to engage in this type of discussion. Informal observations 
were made to check this problem. These observations indicated that students 
followed the instructions, with the exception that students were aware 
that some of their classmates were participating in discussions and others 
were receiving written exercises and art activities. They generally were 
unaware of the specific questions and other activities which occurred in 
the different treatments. Therefore, it is unlikely that simple awareness 
of other treatments influenced the students* performance. It is also un- 
likely that students reviewed with each other the content of their 
discussions or written exercises. Thus, contamination of treatments is 
not a compelling explanation of observed treatment differences. 

The use of dependent measures that appraised students' oral and 
written higher cognitive performance also added strength to the study. 
Yet, these measures pose several problems for interpretation. Except for 
the vocabulary and reading comprehension tests, these measures were 
specially designed. This development was necessary because there were no 
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available measures which reflected the specific content taught in the 
experimental curriculum and because none existed which assessed the 
student outcomes hypothesized to be changed as a result of participation 
in the discussion treatments. 

All of the measures were developed, pilot-tested, and revised to meet 
the standards of "good" tests, including high content validity, high 
internal consistency for the objective measures, and high inter-rater 
reliability for the subjective measures. In most cases the psychometric 
criteria were satisfied; the exceptions are the qu-' ^ty ratings for the 
question-generating measures where the interrater reliability was quite 
low and the absence of item statistics for the measures of higher cognitive 
response ability. This latter weakness reflects a general lack of sufficient 
research concerning the construction of test items v/hich elicit open-form 
responses that are rated by trained scorers (see Coffman, 1971). Also, 
the construct validity of these higher cognitive measures needs further 
study. As a result, treatment differences on higher cognitive outcomes 
must be considered in the perspective of limitations in the instruments 
used to measure these outrjmes. 

While providing many important research controls, the two studies 
investigated a limited number of discussion parameters. Snow (1974) 
described the dangers in limiting the learning environment in order to 
gain control for research purposes. Possible limitations in the present 
research include the assessment of the effects of probing and redirection 
at one level of higher cognitive questioning (50 percent in Study I). 
This limitation becomes particularly significant given the findings of 
Study II. Furthermore, in both studies the treatments were limited to 
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nine hours, using a single curriculum topic, and with only sixth-grade 
students. Variations in sequencing the lesson topics or in the manner 
in which they were presented, i.e., reading or viewing, were not investi- 
gated. In addition, the effects of discussion were studied in conjunction 
with a single viewing and/or reading of each curriculum lesson. The 
research did not attempt to study the possible facilitative effects of 
discussion in conjunction with other teaching strategies such as the use 
of advance organizers, role-playing, and review. 

Perhaps the most significant limits on the general izabil ity of the 
findings are the fact that the experimental discussions were conducted in 
small groups of only six students and that the ecology teachers taught from 
semi-programmed discussion plans developed by the researchers which 
were delivered in rigidly defined ways. Therefore, the results probably 
cannot be used to judge the effectiveness or ineffectiveness of the use 
of discussion by teachers in regular classrooms. 

Even with these limitations the findings have potent implications for 
future classroom practice and teacher training. Some of these implications 
will be discussed later. 

One positive note concerning general izabil ity is that many features 
of Study I were repeated in Study II; namely, the same ecology teachers 
taught the lessons, students used the same curriculum, two of the treat- 
ments were identical across the two studies and most of the student outcome 
measures were repeated in both studies. The fact that the students in 
the school district involved in Study II were of a different ability level, 
as judged by scores on a reading achievement test, increases the general - 
izabil ity of the findings to a more representative population of students. 
Also, the replication of certain results adds to general izabil ity. 
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To summarize, the studies were designed to achieve high internal 
validity at the cost of limiting their general izabil ity. The primary 
advantage of this emphasis is that the student effects found in Studies 
I and II can be attributed confidently to the experimental treatments; 
that is, variations in teacher behavior. In view of the design problems 
of previous research on teacher effects (Heath & Nielsen, 1973), this 
emphasis seems justified. Also, despite the use of novel, unstandardized 
measures of student achievement and attitudes, their use is justified by 
the fact that many of them were reactive to the treatments as theory 
would predict. 

TREATMENT EFFECTS 

Both Studies I and II focused upon resefrch questions related to the 
effects of teachers' use of various types of questioning techniques upon 
students* achievement and attitudes. The specific characteristics of 
the treatments varied in order to study the effects of certain teaching 
skills (probing and redirection) and different percentages of higher 
cognitive questions asked by the teacher. The results of these studies 
were presented in Chapters Four and Six. Further discussion follows. 

Achievement Outcomes 

The overriding finding in both studies was that discussion was more 
effective in bringing about desired changes in student achievement than 
a no-discussion instructional experience. Planned comparisons of all 
discussion treatments with the art activity treatment in Study I revealed 

220 

o 

ERIC 



that the combined discussion treatments produced significantly higher 
scores on 12 of the 16 achievement variables. Nine such significant 
differences were found in Study II. The results suggest that discussion 
following initial viewing and/or reading of curriculum materials signifi- 
cantly improves: 

- acquisition and retention of intentional and incidental information; 

- ability to respond in oral and written form to curriculum-relevant 
higher cognitive questions, and to extend higher cognitive 
thinking into related content areas; and 

- ability to generate curriculum-relevant questions that are pertinent, 
specific, and which contain requests for rationale. 

These findings were based on a comparison of the discussion treatments 
with an art activity treatment in which the learning experiences following 
the viewing and/or reading of the curriculum materials were related to the 
curriculum content in only the broadest sense. Additional insight into 
the effects of discussion can be gained by comparing the Study I discussion 
treatments and the written exercise treatment. 

In the written exercise treatment students responded to the same 
questions as the students who participated in the discussion treatments 
except that the questions were presented in written form. According to 
reports from the ecology teachers, the written exercise treatment was 
very difficult to maintain. Students often had to be persuaded to stay 
with the writing task. Various reward techniques had to be applied to 
encourage student motivation in this treatment (see page 22 for discussion 
of these techniques). Nonetheless, students in the written exercise 
treatment did as well as students in the various discussion treatments 
on all of the measures of information recall. Writing responses to 
questions appeared to develop knowledge acquisition as effectively as 
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participation in a discussion of the same questions. On the other hand, 
students in the discussion treatments, particularly ^tudents in the 
p\:;bing and redirection treatment, gave better oral and written responses 
to curriculum-relevant higher cognitive questions; , they also gave better 
written responses to questions requiring transfer to another curriculum 
topic. 

The various discussion treatments in Study I made a significant 
difference only when contrasted with the written exercise treatment. They 
did not differ significantly from each other in student achievement outcomes. 

Several plausible explanations for this finding can be offered. One 
explanation is linked to the assumption underlying teacher use of probing 
and redirection--that is, that probing and redirection provide a method 
of helping students arrive at a desired level of response to a question. 
In the discussion treatments in Study I these desired responses were 
achieved through two procedures: (a) teacher use of probing and redirection; 
and/or (b) by having the teacher provide the desired answers to both fact 
and higher cognitive questions when no students gave them. This latter 
situation, of course, occurred more frequently in the no probing and re- 
direction and the filler activity treatments than in the probing and 
redirection treatment. In the written exercise treatment, on the other 
hand, students obtained input regarding desired responses only if they 
checked their answers against the exemplary answer sheets that were provided. 
Therefore, it appears that the effects of probing and redirection become 
apparent only when teacher use of probing and redirection is compared with 
situations in which student contact with teacher-provided exemplary responses 
varies in a more natural way than was permitted in the discussion treatments. 
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As long as students are exposed to exemplary responses, whether by the 
teacher (no probing and redirection and filler activity treatments) or 
by the student (probing and redirection treatment), higher cognitive skills 
are developed. Without such exposure, students acquire a lower level of 
skill . 

The lack of significant differences in student acquisition of know- 
ledge in the discussion treatments and the written exercise treatment 
further supports this interpretation of the findings. Since the information 
required to answer the fact and multi-fact questions asked in discussion 
or in written form can be found in the curriculum materials themselves, 
exemplary responses would not be as critical to student learning in these 
areas. Access to exemplary responses, no matter how provided, appears to 
have a significant effect only when the learning moves beyond the infor- 
mation contained in the curriculum itself. A secondary analysis of the 
Study I data is recommended to investigate more completely, the effects 
of providing exemplary responses through both probing and redirection and 
teacher "telling." Such an analysis would provide a further test of the 
above hypothesis. 

In Study II, the specific feature of the discussion situation that was 
investigated was the effect of the percentage of higher cognitive questions 
asked by the teacher during the discussion. Using the semi -programmed mate- 
rials, the ecology teachers asked 25 percent, 50 percent, or 75 percent higher 
cognitive questions depending upon the treatment being conducted. The 
effects of these treatments were compared with one another and with an 
art activity treatment. As in Study I, filler activities were used to 
equate the time c,' the three discussion treatments, and teachers provided 
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exemplary responses to questions if students failed to provide the desired 
response. 

The most impressive finding from this study was the unexpected difference 
in learning outcomes between students in the 50 percent HCQ treatments and 
students in the 25 percent HCQ and 75 percent HCQ treatments. The drop in 
achievement outcomes in the factual areas for the 50 percent HCQ treatment 
was not anticipated. To aid in interpreting these results, additiorial 
analyses were conducted by Dr. Richard Snow, Stanford University. These 
are reported in Extended Analysis of Two Experiments on Teaching (Snow, 
et al . , 1976). One plausible explanation is that the instructional purpose 
of the 25 percent and 75 percent HCQ discussions may have been more obvious 
to the students and thus facilitated their learning. In the 50 percent 
treatment, the even mixture of fact and higher, cognitive questions and the 
transition from one type to another during the discussion may have been 
confusing to students. 

The V-shaped findings in Study II also have implications for inter- 
preting the results of Study I, since the Study I discussions were built 
around the semi -programmed format of the 50 percent HCQ treatment. Un- 
fortunately, fhe possible interactive effects between this treatment 
condition and probing and redirection on Study I findings cannot be deter- 
mined from the available data. Additional research is necessary utilizing 
the 25 percent HCQ and 75 percent HCQ semi -programmed materials as a basis 
for clarifying the effects of probing and redirection. 

In comparisons of the findings of Study I and Study II, another issue 
that merits further inquiry was identified. This is the relationship that 
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may exist between students' reading ability, the context of the discussion, 
and achievement outcomes. 

Although achievement scores were adjusted to incorporate differences in 
students* reading ability within each study, the average reading ability of 
the students in Study II was somewhat higher than that of the students in 
Study I. The average score for Study I students on the CTBS, Form Q, 
Level 2, was 55.27 (grade level equivalent of 5.2); in Study II the average 
score on the CTBS, Form Q, Level 2, was 63.72 {grr:ide level equivalent of 6.2). 

It also appears that the significant differences between the combined 
discussion treatments and the no-discussion art activity treatment foViOW 
different patterns in the two studies. In Study I, nine of the 12 signifi- 
cant differences were on measures of higher cognitive outcomes. In contrast, 
in Study II, only four of the nine significant differences were on measures 
of higher cognitive outcomes. The larger number of significant differences 
in Study I than in Study II suggests that discussions contribute more to 
skill development, particularly higher cognitive development, for students 
with lower reading abilities, than for students with higher reading abilities.. 

In summary, the combined results of Studies I and II with respect to 
student achievement outcomes indicate that the total context of the discission 
including the type of students who are involved, the overall structure and 
purpose of the discussion, and the total set of teaching strategies employed 
may be more important to learning than specific differences in teacher use 
of isolated skills such as probing, redirection, and number of higher cog- 
nitive questions asked. 

Based on this finding, we suggest that further study of isolated 
teaching skills without regard for the students who are involved in the 
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teaching-learning situation and the purpose of the instruction does not 
appear to be warranted. Training in use of teaching skills separate from 
the larger context of instruction also needs to be re-examined. Merely 
counting how many times a teaching skill is used is insufficient evidence 
to determine that effective teaching has occurred. 

Attitude Outcomes 

In both Study I and Study II, students* attitudes toward curriculum- 
related topics, toward discussions in general, and toward treatment-specific 
learning experiences were measured. 

The results were similar in both studies. Neither the format of the 
discussions nor the presence or absence of discussions appear to affect 

student attitudes. The few significant differences that did occur probably 
should be attributed to chance given the larger number of comparisons that 
were made in each study. In Study I, the only attitudinal measure which 
differentiated significantly between the discussion treatments and the 
art activity treatment was the Alligator subscale of the Word Association 
Scale. However, each of the discussion means was higher than the art 
activity mean for five of the six subscales included in this measure. In 
Study II, the results for the attitude scales indicate that the discussion 
groups expressed significantly more positive attitudes on the Alligator and 
Wolf subscales of the Word Association Scale than did the art activity 
groups. The art activity groups also had the lowest mean on two other of 
the six subscales. These findings replicate the Study I results and provide 
further support for the generalization that students' attitudes toward 
discussion are positive. 
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In retrospect, this finding is not unexpected. All of the Study I 
and II treatments were an unusual experience for the students. Regardless 
of the treatment to which a student was assigned, he had an opportunity to 
"jngage in a learning activity that differed from his usual classroom 
routine. Since the treatments lasted for only two weeks, the change in 
routine alone probably would contribute to a positive attitude for all 
students at the end of the two-week period. Treatments of longer duration 
appear to be necessary in order to reveal differences in students* attitudes, 
if such differences do exist. 
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SECONDARY QUESTIONS 

The designs for Studies I and II permitted the investigation of three 
secondary questions. The first relates to differences in students' higher 
cognitive outcomes based upon oral and written measures; the second relates 
to intentional versus incidental learning; the third to possible competing 
hypotheses. 

Oral Versus Written Measures of Higher Cognitive Response in Studies I and II 

One of the major assumptions underlying the design of the dependent 
measures of achievement in the two studies was that the effects of discussions 
would be assessed best by using student achievement measures that closely 
paralleled the oral response patterns elicited by the discussion treatments 
Therefore, an Oral Test was designed to meet these specifications: the 
questions were asked orally, students gave oral responses, and the responses 
were open rather than restricting the answer to multiple-choice discriminations. 

An assessment of the sensitivity of the Oral Test may be made by com- 
paring students' outcomes on this test with their outcomes on the Essay Test. 
A reasonable hypothesis is that the discussion treatment groups will make 
greater gains on the Oral Test than on the Essay Test. Also, one can 
hypothesize that the written exercise treatment group of Study I will make 
greater gains on the Essay Test than on the Oral Test, since the former 
measure is more consistent with the response-modality which dominated 
the written exercise treatment. 

Since the Oral and Essay Tests contained different numbers of items 
students' outcomes on the two tests were equated by computing average S'::nes 
per item. The same rating procedures were used on both tests. Therefore, 
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similar levels of performance would be expected to result In similar average 

scores per item on both tests. Two scores were derived for each item: 

a content score--the number of predictions, solutions, supported 
opinions, explanations, and inference given by the student, 

- a logical extension score--the number of "because" and "if-then" 
relationships supplied by the student. 

The first analysis tested the hypothesis that discussion treatment 
groups made greater gains on the Oral Test than on the Essay Test, The 
average scores per item for the combined Study I discussion treatment 
groups were 1.01, and 1.45 on the pretest and posttest administrations 
of the Oral Test Content Scale, respectively. In contrast, their average 
scores per item on the Essay Test Content Scale were .77 on the pretest 
administration and .88 on the posttest administration. The Logical Extension 
Scales for the two tests showed similar differences. The combined discussion 
treatment groups increased their average score per item on the Oral Test 
Logical Extension Scale from .30 on the pretreatment administration to .55 
on the posttreatment administration. In contrast, their scores on the 
Essay Test Logical Extension Scale barely changed from ,09 to ,10, 

The same pattern of results is found in Study II, For the combined 
discussion treatment groups in this study, the average score per item on 
the Content cale of the Oral Test increased from 1,01 to 1,45, whereas 
the increase on the same scale in the Essay Test was only from ,87 to ,99, 
Similarly, the combined discussion groups' increase on the Oral t Logical 
Extension Scale was from ,39 to .61, whereas the change on the Essay Test 
Logical Extension Scale was minimal, from ,17 to .18, 

These findings lend support for the hypothesis that discussions have more 
effect on students' ability to respond to higher cognitive questions in oral form 
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than on their ability to respond to similar questions in paper-and-pencil form. 
However, the data presented here do not provide a rigorous test of the hypoth- 
esis. For example, the data analysis assumes that the test items in the Oral 
Test and Essay Test are parallel in form and difficulty; however, the sound- 
ness of this assumption could not be checked empirically using the available 
data. Moreover, there is evidence that rater awareness of the time of 
administration cf the Oral Tests may have influenced their scoring of 
students' performance. The limits of the generalization require further 
testing. For example, there may be a point in cognitive development when 
students* writing ability may come to equal or even exceed their ability 
to respond orally. 

The second hypothesis of interest in comparing the use of oral versus 
written achievement measures is whether students in the written exercise 
treatment in Study I made greater gains on the Essay Test than on the Oral 
Test. 

Again, using average scores per item, the students in the written 
exercise treatment scored an average of 1.16 per item on the pretreatment 
administration of the Oral Test Content Scale and an average of 1.27 per 
item on the posttreatment administration. In contrast, their average 
score per item on the Essay Test Content Scale declined slightly, from 
.84 to .82. Their performance on the Oral Test Logical Extension Scale 
increased from an average score per item of .38 on the pretreatment 
administration to .47 on the posttreatment administration. Again, a 
decline was observed on the same scale in the Essay Test, from an average 
score per item of .12 on the pretreatment administration to an average 
score per item of .08 on the posttreatment administration. 

These results do not support the hypothesis of differential modality 
effects for the written exercise treatment. Instead, they indicate that 
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practice in completing written exercises did not positively improve learning 
measures of the same modality as the treatment. However, students' per- 
formance on the pretreatment and posttreatment administrations of the Oral 
Test indicates that they were making gains in higher cognitive processing 
abilities. Thus, it appears that the written exercise treatment group 
learned from the written exercise teaching strategy, but were unable to 
express their learning in written form. 

These results argue for the need to use oral response measures when 
measuring sixth-grade students' higher cognitive ability regardless of 
the treatment conditions being studied. Apparently, requiring students' 
to write their responses limits and/or inhibits the number and type of 
higher cognitive relationships they express. 

The implications of this finding are considerable both for future 
research and for interpretation of past research. Upper elementary students' 
higher cognitive responses have been measured in oral form in few if any 
other research studies to date. Lack of such data may have imposed severe 
limitations on the findings of those studies. The importance of including 
such measures in future studies would serve two purposes: the further 
testing of the hypotheses raised by the current research as well as 
"covering the bases" in studying the effects of other instructional 
treatments. 

Intentional versus Incidental Knowledge Acquisition in Studies I and II 

For purposes of this discussion, whether a particular measure reflects 
intentional or incidental learning can be determined by referring to the 
treatment conditions imposed in the two studies. If the knowledge required 
to respond to an item on the Information Test was covered in the semi- 
programmed discussions, the item was considered to be a measure of 
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"intentional" knowledge acquisition. However, if the knowledge required 
to respond to the item was contained in the ecology curriculum but not in 
the semi -programmed discussions, the item was considered to be a measure 
of "incidental" knowledge acquisition. 

It should be noted that inquiry into this aspect of the research was 
made possible through the careful definition and implementation of the 
ecology curriculum and the various treatrr.cnts. Only when treatments are 
well delimited can such hypotheses be investigated. 

In Studies I and II it is reasonable to hypothesize that students 
would recall curriculum information which was covered in the discussions 
better than they would recall curriculum information which was not discussed 
in this way. This hypothesis can be tested by comparing the discussion 
treatment groups' performance on the intentional scale of the Information 
Test with their performance on the incidental scale of the same test. 
Since the intentional and incidental scales are of different lengths and 
were not constructed by drawing items , 3ndomly from an item pool, compari- 
son of scores from the two scales needs to be made cautiously. 

To equate scale length, an average score per item was computed; that 
is, a treatment group's mean score on the scale was divided by the number 
of items included in the scale. A rough index of the equivalence of item 
difficulty in the intentional and incidental scales was obtained by com- 
paring the art activity treatment j'roups' performance on these scales. 
The two scales should have approximately equal mean item scores since 
they are equally "incidental" for this group.* 

* The items in the intentional scales in the two studies are "intentional" 
only for the discussion treatment groups. 
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The average scores per item for the combined discussion treatments in 
Study I was .61 for the posttreatment Intentional Scale I and ,44 for the post- 
treatment Incidental Scale I. As predicted, discussion appears to facilitate 
the acquisition of intentional facts more than it facilitated the acquisi- 
tion of incidental facts. However, the average scores per item for art 
activity treatment I were ,43 on the posttreatment Intentional Scale I and 
.35 for the posttreatment Incidental Scale K This difference suggests 
that the intentional scale was slightly less difficult than the incidental 
scale. The hypothesis that discussion treatments fostered the learning of 
intentional scale items more than incidental scale items is still tenable, 
the .gh, since the difference between the intentional scale and incidental 
scale scores for the art activity is small and does not account for all the 
difference observed between the intentional and incidental scales for the 
discussion treatment groups. 

A similar analysis of the delayed administration scores on the inten- 
tional and incidental scales provides further support of the "intentional 
learning" hypothesis. The average scores per item for the combined discussion 
treatment groups in Study I were .53 oj the intentional scale and ,41 on 
the incidental scale. The corresponding average scores per item for the 
Study I art activity treatment group were .38 and .35, respectively. Even 
taking Into account the possibility of slightly easier items on the inten- 
tional scale than on the incidental scale, the discussion treatment groups 
performed better on the intentional scale than they did on the incidental 
scale. 

Jtudy II used different intentional and incidental scales, but the 
items were derived from the same item pool of 27 items on the Information 
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Test used in Study I. Again, average scores per item were calculated since 
the two scales included different numbers of items. The average scores 
per item for the combined discussion treatment groups of Study II were .77 
on the post administration of the intentional scale and .56 on the post 
administration of the incidental scales. The corresponding average scores 
per item for the Study II art activity treatment group were .66 and .50, 
respectively. 

This analysis suggests that the intentional scale contained sub- 
stantially easier items than the incidental scale. In Study II, the magnitude 
of this difference is slightly less than the difference between the 
intentional and incidental scales? for the discussion treatment groups, 
suggesting that, in this study, differences between the intentional and 
incidental average item scores for the discussion groups were probably 
due to the differences in item difficulty for the two scales rather than 
real differences in intentional versus incidental learning. 

The results basically are the same for the analysis of the delayed 
administration of these scales in Study II. The average scores per item 
for the combined discussion treatment groups were .72 and .52 on the delayed 
administration of the intentional and incidental scales, respectively; the 
corresponding scores for the art activity treatment group were .60 and .47, 
respectively. While there appears to be a slight advantage for the combined 
discussion groups on the intentional scale, this difference 1s probably due 
to differences in item difficulty rather than differences in intentional 
versus incidental learning. 

Another test of the hypothesis that covering specific facts in a 
discussion promotes later recall of the same facts can be made by examining 
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the data for the 25 percent Intentional Scale. This scale includes items 
which were intentional for the 25 percent higher cognitive questions treat- 
ment in Study II, but incidental for the other discussion treatments in 
the study and for the art activity treatment. As predicted, the average 
score per item on the 25 percent Intentional Scale for the 25 percent 
treatment groups was substantially higher (.45) than the average scores 
per item for the other treatments, which differed little among themselves 
(range = .36 to .37) . 

It also is of interest to determine whether inserting fact questions 
in written exercises, as in the written exercise treatment of Study I, 
affects intentional and incidental learning in the same way. The average 
scores per item for this group cn the intentional and incidental scales 
were .62 and .46, respectively. The corresponding scores on the delayed 
administration of the same scales were .52 and .42, respectively. These 
scores are similar to those reported above for the combined discussion 
treatment groups in Study I, and similar interpretations apply. 

It must be emphasized that the analyses presented here lack the rigor 
needed to provide a definitive test of the "intentional learning" hypothesis. 
They are exploratory in nature. However, they provide some support for 
the hypothesis that if a teacher wants students to learn a specific set of 
facts in a curriculum, an effective approach is to cover these facts in an 
oral discussion or written exercise involving question-and-answer. 

Competing Hypotheses 

Three possible competing hypotheses to explain treatment group 
differences are of interest in interpreting the outcome of Studies I and II. 
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These are the effects of the'status variables of initial student ability, 
exposure to treatments, and the effects of the individual ecology 
teachers. 

Measures of initial ability were ob dined from student reading scores 
on the state-administered Comprehensive Tests of Basic Skills. Differences 
in reading ability between the Study I and Study II students have already 
been discussed with respect to .their possible role in explaining differences 
in findings between the two studies. In this section of the discussion, 
therefore, attention will be given only to possible effects of initial 
ability within each study separately. 

To check on the equivalence of ability among treatment groups within 
each study, an analysis of variance was performed on total reading scores. 
As discussed in Chapter Four, in Study I there were no statistically 
significant differences in total reading scores attributable to treatments, 
teachers, classes, squares, or treatment by square interactions. It should 
be noted, however, that the average total reading scores for each treatment 
were ordered in the direction of a priori hypotheses about the probable 
effects of each discussion treatment: that is, the students in the probing 
and redirection treatment had the highest mean total reading score; the 
students in the no probing and redirection, filler activity, and art 
activity treatments had slightly lower mean scores in that order. 

In Study II no statistical differences in total reading scores were 
identified for student classification by treatment, class, teacher, square, 
or treatment by square. Moreover, the absolute differences between treat- 
ment group means on total reading score were very small. 
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It appears, therefore, that within each study, differences between 
treatments in student outcomes should not be attributed to differences in 
reading ability of the groups. Moreover, since the dependent measures in 
both studies were residual ized on total reading scores whenever assumptions 
underlying this procedure were satisfied, any treatment differences that 
were found may be attributed to treatment effects rather than to the effect 
of initial abil ity. 

Students' exposure to treatments was measured by the number of sessions 
attended. Analyses of variance, reported in Chapters Four and Six, showed 
no significant differences among treatment groups on this variable in either 
study. Also, the correlations between sessions attended and the other 
dependent variables were low. In Study I, the largest correlation was -.27, 
with only five exceeding .10 in absolute value. In Study II, the largest 
correlation was .12, with only three exceeding .10. Thus, differences in 
exposure to treatment are not related to observed variability in student 
learning. 

In both studies, teachers were trained to implement a prescribed 
curriculum and to conform to scripted variations in teaching behavior. 
The observational data concerning fidelity of treatment implementation 
(see Tables 2, 3, 23, 24) show that it was possible to train teachers to conform 
to precise standards of teaching performance. The results of the analyses 
of variance for teacher effects are also impressive. These analyses, 
presented in Chapters Four and Six, show that teacher effects account for 
very little of the variance in student performance on the dependent measures. 
Differences attributable to teacher effects reached statistical significance 
for only three of the 64 dependent variables measured across both studies. 
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This number is exactly the number of significant differences at the .05 
level that would be expected by chance. 

The method of studying teacher effectiveness experimentally by 
"programming" the teachers to vary their behavior has been used previously 
in research. However, the studies reported here represent one of the most 
rigorous uses of the method yet attempted. Most noteworthy is the fact 
that in Studies I and II the same teacher was trained to implement several 
different teaching strategies. The advantage of this method is that it 
controls effects attributable to a single teacher by allowing them to be 
systematically distributed across all treatments. A much larger sample 
of teachers would be required to achieve the same control if the researcher 
wished to randomly assign separate groups of teachers to be trained to 
implement each strategy. It should be emphasized, however, that the ecology 
teachers used in the two studies were preselected for their interpersonal 
skills and their interest in educational research. The effectiveness of 
the experimental methods used in these studies may not hold for all teachers 
and all teaching strategies. 

IMPLICATIONS FOR USE OF MINICOURSES 1 AND 9 

The teaching skills that were investigated in Studies I and II were 
taken from the skills included in Minicourse 1, Effective Questioning - 
Elementary Level , and Minicourse 9, Higher Cognitive Questioning . 

At the time that the Minicourses were developed and field tested, the 
effect of training upon teacher behavior was studied. Comparison of 
these findings with those from the present research provides several 
important guidelines for future use of the courses. 
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Since teacher use of higher cognitive questions was included in both 
Minicourses, results from the main field tests of the courses provide an 
indication of teacher use of this -ski 11 within a more natural classroom 
environment. Because the lessons used in the main field tests were 
markedly different from the semi-prograrrmed discussion materials used in 
Studies I and II, the main field test findings cannot be compared directly 
with the treatment conditions in the present research. However, the find- 
ings can offer some guidelines for future teacher training efforts. 

The Minicourse 1 main field test (Borg, et al., 1969) indicated that 
before training teachers used an average of 38 percent higher cognitive 
questions; immediately after training they used 50 percent higher cognitive 
questions; three years later they used 51 percent. In the Minicourse 9 
main field test (Gall, Dunning, Galassi, & Banks, 1970) fourth through 
sixth-grade teachers used an average of 49.9 percent higher cognitive 
questions before training and 67 percent after training. The control group 
teachers in this field test used 52.2 percent higher cognitive questions 
in the pre-training lesson and 45.3 percent in the post-training lesson. 

Since Study II results suggest that the 50 percent higher cognitive 
questions treatment was, in sone respects, the least effective treatment, 
the field test findings for Minicourses 1 and 9 appear to present some 
problems. After training, the Minicourse 1 teachers performance level 
reached the level of the least effective treatment~50 percent higher 
cognitive questions. Minicourse 9 teachers increased their use of higher 
cognitive questions beyond the 50 percent level but not to the 75 percent 
level. Training based on either of the Minicourses, therefore, may need 
to be redesigned. Teachers may need to increase the number of practice 
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microteach lessons they conduct in order to attain flexibility in the use 
of higher cognitive questions and to acquire the ability to plan and conduct 
lessons containing 25 and 75 percent higher cognitive questions as well as 
50 percent. 

Furthermore, since the present research suggests that a teacher's use 
of higher cognitive questions may not, in and of itself, U^ad to improved 
performance for all students, trainers using Minicourses 1 and 9 should 
give special attention to the context of the instructional situation. 
In particular, attention should be given to the structure of the discussion 
in which the questions are asked. The more effective treatments in Study II 
—25 percent HCQ and 75 percent HCQ--had an obvious purpose and structure. 
The strategy of constructing and implementing "programmed" discussions such 
as those used in Studies I and II, that is, discussions containing fact 
and higher cognitive questions relevant to the curriculum objectives and 
presented in a purposeful sequence, probably should be added to the 
Minicourse training. 

IMPLICATIONS FOR FUTURE RESEARCH 

The research reported in Studies I and II has several important 
implications for educational research. 

The most important implication has to do with the dimensions of the 
teaching-learning situation that should be studied. Much of previous 
research on teaching has focused upon teacher use of specific skills with 
little attention to the entire teaching-learning situation. In the pre- 
sent research, the total context of the discussion treatment (i.e., the 
sequence in which the questions were asked as well as the questions 
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themselves and the entire set of behaviors used by the teacher rather than 
just the use of probing and redirection) had to be considered in order to 
explain the research results. It appears that future research on teaching 
would benefit by similar concern for the total instructional context rather 
than for a few specific teaching skills. 

In order to expand the dimensions of the teaching-learning situation 
to be studied, the curriculum, the structure of each lesson, and the 
specified aspects of teaching must be carefully controlled. The semi- 
programmed approach applied in Studies I and II is one method for controlling 
the "treatment." Other approaches need to be^ developed and tried- -The 
semi -programmed approach, while controlling treatment conditions, severely 
limits the general izabil ity of the research findings to teaching in general. 
Approaches that accommodate more "natural" variation in teaching are needed. 

The results of Study I suggest that multiple teaching strategies-- 
teacher use of probing and redirection and/or teacher provision of exemplary 
responses--may result in similar outcomes for students. To our knowledge, 
no studies have been conducted that seek to determine what, if any, options 
in the use of teaching skills are available to teachers. The work of 
Brophy and Good (1972) and Brophy and Evertson (1974) investigated 
effective teaching in urban and suburban settings. This research 
identified different teaching strategies as effective in these sites. Other 
research has searched for relationships between certain teaching skills 
and student outcomes. To our knowledge, however, to date, no research 
has attempted to test experimentally (intentionally) whether two or more 
teaching strategies are equally effective in achieving the same student 
outcomes with similar students and/or different students. Given that 
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teachers have different teaching styles, identifying such al ternatives-- 
if they exist as suggested in Study N^has important implications for both 
teaching and teacher training. 

The comparison of the results of Study I and II supports the theory 
that students with different entry level abilities perform better in one 
treatment than another. The comparison of the two studies also suggests 
that students with different entry levels may learn different things as 
a result of the same treatment. The reanalysis to be reported by Snow 
and his colleagues will provide further insight into this area of aptitude- 
treatment interactions. The research reported here supports continued 
emphasis in this area of research on teaching and learning. It stresses 
the importance of measuring a variety of student entry skills. 

In both Studies I and II, considerable attention was given to mc :^ 
student outcome measures with the objectives of the treatment conditions. 
This, in turn, required the development of several new measures of students' 
cognitive abilities. These included measures of students' ability to 
express the results of their thinking in oral form. The results of the 
studies, particularly the large number of treatment effects for the higher 
cognitive measures in Study I, suggest that the measures were important to 
the research. Future research concerned with student learning outcomes 
should no longer limit measurement of the outcomes to fact-recall paper- 
and-pencil tests. Much remains to be done to establish the validity and 
reliability of both written and oral measures of higher cognitive per- 
formance, but their potential for increasing our understanding of the 
effects of different instructional treatments appears clear from the 
findings of Study I and Study II. 
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APPENDIX A 



Objectives and Skills of 
Minicourse 1 and Minicourse 9 
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TABLE A-1 



Objectives and Skills of 
Minicourse 1, Effective Questioning Elementary Level 



INSTRUCTIONAL SEQUENCE 1 

Objective To change teacher behavior (teaching techniques and 

practices) in order to increase pupil readiness to 
respond to discussion questions. 

Skills Covered Asking question, pausing three to five seconds, then 

calling on pupil . 

Dealing with incorrect answers in an accepting, non- 
punitive manner. 

Calling on both volunteers and nonvolunteers in order 
to keep all pupils alert and to distribute participati 

INSTRUCTIONAL SEQUENCE 2 

Objective To improve teacher skills so as to decrease the amount 

of teacher participation and increase the amount of 
pupil participation. 

Skills Covered Redirecting the same question to several pupils. 

Framing questions that call for longer pupil responses. 

1. Asking for sets or groups of related facts when 
formulating information-level questions. 

2. Avoiding Yes or No replies. 

Framing questions that require the pupil to use higher 
cognitive processes. 

INSTRUCTIONAL SEQUENCE 3 

Objective To increase teacher use of probing techniques in order 

to guide the pupil to more complete and thoughtful 
responses. 
Skills Covered Prompting. 

Seeking further clarification and pupil insight. 
Refocusing the pupil's response. 

INSTRUCTIONAL SEQUENCE 4 

Objective To reduce teacher behavior that interferes with the flow 

of the discussion. 
Skills Covered Observing the following rules: 

1. Teacher should not repeat his own questions. 

2. Teacher should not answer his own questions. 

3. Teacher should not repeat pupil answers. 
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TABLE A-2 



Objectives and Skills of 
Minicourse 9, Higher Cognitive Questioning 



Preliminary Lesson 
Objective 

Skills Covered 

LESSON 1 
Objective 

Skills Covered 

LESSON 2 
Objective ' 
Skills Covered 



LESSON 3 
Objective 
Skills Covered 

LESSON 4 
Objective 
Skills Covered 



To introduce the first three question types in Bloom's 
taxonomy of cognitive objectives. 

Writing and classifying knowledge, comprehension, and 
application questions. 



To develop your skill in helping students improve the 
quality of their answers to higher cognitive questions. 

Using performance criteria in order to judge student 
responses. Using probing questions to help students 
improve their answers. 



To increase your use of analysis questions. 

Asking three types of analysis questions: 

1. Having students think of motives or causes to 
explain observed events. 

2. Having students make inferences, interpretations, 
or generalizations. 

3. Having students find evidence to support general- 
izations, interpretations, or conclusions. 



To increase your use of synthesis questions. 

Asking three types of synthesis questions: 

1. Having students make predictions. 

2. Having students solve problems. 

3. Having students produce original communications. 



To increase your use of evaluation questions 

Asking four types of evaluation questions: 

1. Having students give their opinions about issues. 

2. Having students judge the validity of ideas. 

3. Having students judge the merit of problem-solutions 
4] Having students judge the quality of art and other 

products. 
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APPENDIX B 

Psychometric Statistics for Study I Measures 
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TABLE B"l 
Study I 

Correlation Matrix of Ecology Information Subtests 



VARIARI F 


1 






4 


5 

J 




7 

/ 


7 ■ ■ " '' ' 

8 


9 

J 


1. Total Scale (Pre) 




.6/ 


.88 


.56 


.48 


.54 


.48 


.40 


.47 


2. Intentional Scale I (Pre) 






.24 


.37 


.37 


.31 


.31 


.32 


.26 


3. Incidental Scale I (Pre) 








.51 


.38 


.51 


.44 


.32 


.45 


4. Total Scale I (Pest) 










.87 


.93 


.80 


.69 


.76 


5. Intentional Scale I (Post) 












.63 


.71 


.71 


.60 


6. Incidental Scale I (Post) 














.74 


.57 


.75 


7. Total Scalr, (De^ay) 
















.88 


.93 


i 8. Intentioneil Scale I (Delay) 


















.64 


9. Incidental Scale I (Delay) \ 
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Study I 

Alpha Coefficients and Standard Errors of Measurement of 
Ecology Information Subtests 



PRETEST 



Treatment 


Samp] e 
Size 


Total Scale 
(27 Items) 


Intentional 
Scale I 
(10 Items) 


Incidental 
Scale I 
(17 Items) 






Al pha 
Coeff 


Sem 




Sem 




Sem 




n 


0.44 


2.28 


0.03 


1.33 


0.39 


1.85 


No Probina & Redirection 


70 


0.36 


2.35 


O.OO 


1.33 


0.30 


1.83 


Filler Activity 


70' 


0.39 


2.23 


0.35 


1 .29 


0.26 


1.81 ■■■ 


Art Artivitv I 


53 


0.42 


2.2S 


0.11 


1 .36 


0.28 


1.83 


Written Exercises 




0.39 


2.25 


0.37 


r.27 


0.30 


1.84 " 



















POSTTEST 



Treatment 


Sample 
Size 


Total Scale 
(27 Items) 


Intentional 

Scale I 
(10 Items) 


Incidental 
Scale I 
(17 Items) 


Mipna 
Coeff 


Sem 


c< 


Sem 


ex. 


Sem 


Probing & Redirection 


71 


0.85 


2.25 


0.76 


1.27 

1:32" 


0.75 
0.74 

.A 67. 


1.84 
1 .85 


Mo Probing & Redirection 


67 


0.84 


2.28 
■ 2'.30 

--2^3.4„.. 
2.34 


0.74 
0.69" 


Filler Activity 


69 


"0.79 

.(L.6Z_ 
_0J5_ 


1.33 . 
L..4Q -. 


1 .85 


Art Activity I 


64 


o.fin 


l.Rfi 


Written Exercises 


50 


0.60 


.1^3 6. _ 


- P, 63 


.1.89. 













DELAYED TEST 



Treatment 


Sample 
Size 


Total Scale 
(27 Items) 


Intentional 
Scale I 
(10 Items) 


Incidental 
Scale I 
(17 Items) 






Alpha 
Coeff. 


Sem 




Sem 




Sem 


Probing S Redirection 


67 


0.84 


2.29 


0.74 


1.32 


0.75 


1.84 


No Probinq and Redirection 


65 


0.82 


2.33 


• 0.77 


1 1.33 


0.61 


1.91 


Filler Activity 


65 


0.83 


2.28 


' 0.59 


■ i.34 




'I.8-! 


Art Activity I 


64 


0.72 


2.29 


0.51 


! 1.39 


fee' 


" 1 .80 


Written Exercises 


50 


0.82 


2.29 


0.67 


1 .36 


0.74 


1 .84 




















V 
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TABLE B-3 

Study I 
Correlation Matrix of 
Oral Test Variables 



VARIABLES 


1 


2 


3 : 


4 


1 . Content Scale (Pre) 




.61 . 


.59 


.48 


2. Logical Extension Scale (Pre) 






.44 


.51 


3. Content Scale (Post) 








.66 


4. Logical Extension Scale (Post) 











TABLE B-4 

Study I 
Correlation Matrix of 
Essay Test Variables 



VARIABLES 


1 


2 


3 


4 


1 . Content Scale (Pre) 




.62 


.71 


.44 


2. Logical Extension Scale (Pre) 






' .42 


.39 


3. Content Scale (Post) 








.57 


4. Logical Extension Scale (Post) 
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TABLE B-5 
Study I 

Correlation Matrix of (juestion-Generating Test Variables 
(Paper and Pencil Heasure) 



VARIABLES 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


1. Nonpertinent Questions (Pre) 




-.18 


-.11 


-.05 


-.51 


.53 


-.08 


-.07 


-.12 


-.18 


2. Pertinent Questions (Pre) 






.37 


.29 


.12 


-.08 


.61 


.21 


.17 


.23 


3. Soecificitv (Pre) 








-.01 


.15 


.00 


.15 


.39 


-.01 


.21 


4. Requests for Rationale (Pre) 










.12 


.01 


.15 


.05 


.40 


.09 


5. Quality Ratino (Pre) 












-.27 


.02 


.04 


.09 


.42 


6. Nonpertinent Questions (Post) 














-.15 


-.05 


-.10 


-.26 


7. Pertinent Questions (Post) 
















.42 


.28 


.24 


8. Specificity (Post) 


















.19 


.28 


9. Requests for Rationale (Post) 




















.15 


10. Quality Ratinq (Post) 
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TABLE B-6 
Study I 

Intraclass Correlation Coefficients for 
Question-Generating Test Variables 
(Paper and Pencil Measure) 



VARIABLE 


Pretest 


Posttest 


Nonpertinent Questions 


.84 


.55 


Pertinent Questions 


.97 


.95 


Specific Questions 


.83 


.87 


Requests for Rationale 


.90 


.94 


Qual ity Rating 


.29 


25 



Table S : 

Study I 
Correlation Matrix of 
r;Mr:Stion-Generating Test Variables 
(Oral Measure) 



VARIABLES 


1 


2 


3 


4 


5 


6 


1. Nonpertinent Questions (Pre) 




-.09 


-.14 


. .50 


.07 


-.04 


2. Pertinent Questions (Pre) 






.55 


.04 


.46 


.32 


3. Quality Rating (Pre) 








- .01 


.45 


.43 


4. Nonpertinent Questions (Post) 










-.03 


-.10 


5. Pertinent Questions (Post) 












.57 


6. Quality Rating (Post) 
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TABLE B-8 
Study I 

Correlation Matrix of Word Association Sutscales 



VARIABLES 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


12 


1. Balance of Nature (Pre) 


- 


.28 


.89 


.08 


.16 


.11 


.30 


.20 


.07 


.08 


.10 


.10 


I Ecoloqy (Pre) 






.20 


.20 


.24 


.17 


.30 


.37 


.17 


.19 


.18 


.15 


3. Alli(jator (Pre) 








.02 


.58 


.04 


.16 


.17 


.46 


.03 


.38 


.03 


4. Air Pollution (Pre) 










.06 


.66 


.16 


.24 


.19 


.30 


.19 


.32 


5. Wolf (Pre) 






• 






.03 


.14 


.16 


.40 


.09 


.52 


.09 


6. Water Pollution (Pre) 














.27 


.23 


.18 


.40 


.23 


.49 


7. Balance of Nature (Post) 
















.43 


.24 


.23 


.34 




8. Ecoloqy (Post) 


















.25 


.33 


.30 


.28 


9. Alliaator (Post) 




















.13 


.65 


.11 


10. Air Pollution (Post) 






















.21 


.79 


11. Wolf (Post) 
























.21 


12. Water Pollution (Post) 
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TABLE B-9 
Study I 

Alpha Coefficients and Standard Errors of Measurement of 
Uord Association Subscales 

PRETEST 



TREATMENT 


SAMPLE 
SIZE 


BALANCE 
OF 

NATURE 


ECOLOGy 


ALLIGATORS 


AIR 
POLLUTION 


WOLF 


WATER 
POLLUTION 


Alpha 
Coeff 


Sem 




Sem 




Sem 




Sem 


o( 


Sem 


o( 


Sem 


Probing & Redirection 


70 


0^70 


4.26 


0.8C 


4.41 


0.81 


4.89 


0.69 


5.01 


0.75 


4.74 


0.67 


5.01 


No Probing & Redirection 


68 


O./ij 


4:r 




0.79 


Ul. 


0.5^ 


ibl 


O.Bb 


4.53 


U[ 


4.96 


Filler Activity 


68 


0.76 


4.52 


0.83i4.21 


0.85 


4.89 


0.61 
0.69 


4.28 


0.85 


4.78 


0.52 


4.601 


Art Activity -I 


60 


0.83 


4.86 


0.89 


4.83 


0.78 


5.58 


5.28 


0.80 


5.24 


0.6? 


5.21 1 


Written Exercise 


50 


0.74 


4.72 


0.91 


4.57 


0.75 


5.09 


0.47 


4.58 


0.82 


4.59 


0.63 


4.60 



POSTTEST 



TREATMENT 


SAMPLE 
SIZE 


BALANCE 

OF 
NATURE 


ECOLOGY 


ALLIGATORS 


AIR 
POLLUTION 


WOLF 


JAT 
POLL 


ER 

UTIOII 


\lpha 
:oeff 


Sem 




Sem 




Se^ 




Sem 


c( 


Sem 




Sem 


Probing & Redirection 




0.85 


4.10 


0.89 


4.02 


0.78 


4.55 


0.31 


4.46 


0.80 


4.08 


0.45 


4.46 


No Probing & Redirection 




0.87 


4.12 


0.91 


B.72 


0.82 


4.91 


0.51 


4.19 


0.89 


4.15 


0.56 


4.19 


Filler Activity 


64 


0.88 


4.05 


0.87 


b.63 


0.89 


4.49 


0.70 


4.30 


0.86 


4.57 


0.72 


4.28 


Art Activity I 


59 


0.91 


3.39 


0.88 


hi 


0.84 


5.24 


0.49 


4.54 


0:88 


4.45 


0.60 


4.82 


Written Exercise.. 


45 


0.82 


^,49 


0.96 


fe.80 


0.72 


4.47 


0.64 


4.61 


0.84 


4,13 


0'.55 


4.49 
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TABLE B-10 

Study I 
Correlation Matrix of 
Gall -Crown Discussion Attitude Subscales 



VARIABLES 


1 


2 


3 


4 


1. Attitude toward Thought Questions (Pre) 




.69 


.55 


.44 


2. Attitude toward Discussions (Pre) 






.52 


.60 


3". Attitude toward Thouqht Questions (Delay) 








.60 


4. Attitude toward Discussions (Delay) 











TABLE B-11 



Study I 

Alpha Coefficients and Standard Error of Measurement of 
Gall-Crown Discussion Attitude Subscales 



PRETEST 



TREATMENT 


SAMPLE 
SIZE 


ATTITUDE TOWARD 
THOUGHT QUESTION 
(11 i tems ) 


ATTITUDE TOWARD 
DISCUSSION 
(19 items) 






Al pha 
Coeff. 


Sem 


0. 


Sem 


Probinq and Redirection 


71 


0.72 


2.68 


0.85 


3.23 


No Probinq and Redirection 


69 


0.70 


2.75 


0.86 


3.39 


Filler Activity 


69 


0.73 


2.74 


0.81 


3.36 


Art Activity I 


64 


0.74 


2.85 


0.80 


3.65 


Written Exercise 


51 ] 


0.80 


2.68 


0.84 


3.35 



DELAYED TEST 



TREATMENT 


SAMPLE 
SIZE 


ATTITUDE TOWARD 
THOUGHT QUESTION 
(11 items) 


ATTITUDE TOWARD 
DISCUSSION 
(19 items) 






Alpha 
Coeff. 


Sem 


a. 


Sem 


Probing and Redirection 


69 


0.83 


2.50 


0.87 


3.43 


No Probinq and Redirection 


65 


0.84 


2.45 


0.86 


3.19 


Filler Activity 


65 


0.81 


2.61 


0.88 


3.34 


Art Activity I 


61 


0.75 


2.81 


0.87 


3.54 


Written Exercise 


51 


0.82 


2.75 


0.83 


3.47 



TABLE B-12 

Study I 
Correlation Matrix of 
Ecology Unit Opinions Subscales 



VARIABLE 


1 


2 


3 


1. Attitude toward peers 




.51 


.59 


2. Attitude toward teacher 






.48 


3. Attitude toward curriculum 









TABLE B-13 



Study I 

Alpha Coefficients and Standard Errors of Measurement of 
Ecology Unit Opinions Subscales 



TREATMENT 


SAMPLE 
SIZE 


ATTITUDE 
TOWARD 
PEERS 

(5 items) 


ATTITUDE 
TOWARD 
ECOLOGY TEACHER 
(18 items) 


ATTITUDE 
TOWARD ECOLOGY 
CURRICULUM 
(9 items) 


Alpha 
Coeff . 


Sem 


a 


Sem 


a 


Sem 


Probing and Redirection 


70 


'0.73 


1.77 


0.89 


2.83 


0.87 


2.23 


No Probing and Redirection 


69 


0.78 


1.67 


0.88 


2.72 


0.81 


2.27 


Filler Activity 


63 


0.71 


1.76 


0.89 


2.91 


0.79 


2.54 


Art Activity I 


63 


0.74 


1.78 


0.84 


2.22 


0.81 


2.69 


Written Exercises 


50 


0.71 


1.67 


0.87 


2.52 


0.89 


1.96 
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TABLE B-14 



Study I 
Correlation Matrix of 
Ecology Discussion Attitude Subscles 



I 

VARIABLE 


1 


2 


1. Attitude toward discussion 




.84 


2. Attitude toward thought questions 







TABLE B-15 



Study I 

Alpha Coefficients and Standard Errors of Measurement of 
Ecology Discussion Attitude Subscales 



TREATMENT 


SAMPLE 
SIZE 


ATTITUDE TOWARD 
THOUGHT QUESTIONS 
(11 items) 


ATTITUDE TOWARD 
DISCUSSION 
(19 items) 






Alpha 
Coeff. 


Sem 


a 


Sem 


Probing aiid Redirection 


68 


0.82 


2.57 


0.91 


3.27 


No Probing and Redirection 


65 


0.87 


2.33 


0.91 


3.00 


Filler Activity 


65 


0.85 


2.39 


0.89 


3.25 
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TABLE B-16 
Study I 

Alpha Coeff icierit and Standard Error of Measurement of 
Ecology Art Project Scale 



1 

TREATMENT 


ATTITUDE TOWARD ART PROJECTS 
(19 items) 


Sample 
Size 


Al pha 
Coeff. 


Sem 


Art Activity (Posttest) 


61 


0.92 


2.99 
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TABLE C-1 
Study II 

Correlation Matrix of Ecology.'Ififorinatiofi Subtests 



VAilIABLES 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


12 


1. total Scale (Pre) 




.60 


.69 


.80 


.62 


.46 


.57 


.54 


.59 


.44 


.46 


.55 


Intentional, Scale II (Pre), 






-ir 


.22 


.32 


.35 


.30 


.21 


.30 


.32 


■.is"' 


.23"" 


l/l5tlntentigrJScare'(Prel'""' 








.36" 


.43 


.26 


.5r 


.36 


.44 


.29 


.45 


.37 


jj"c]denta]..Scale.II (PreL. .. 










'.'ST 


........... 




.52 


"47 


.31 


.33 


.51 


J,!.Jot3!JcaJe ]Postj,^.^^ Z „ 
'erintentionai" Scale iTTPost') " 












......... 


■".80 


787"" 


"84 - 


.67 


.66 


.77 














.52 


.56 


"65 


.69"~ 


■:4o 


.53 


7. 2551 Intentional Scale (Postl 
















'.56"" 


.70 


"49'" 


■*";73" 


W 


8. incidental Scale II (Post) 


















.73 


".iT ■ 


■■"'."53 


■.79"" 


1. TbfaT£aTr[De]ayl ~ 2 
ro.'lntentiial' Scale '(Delay) 




















*;'83 




"M" 






















"M 


■■.'59 ■ 


lTr^5iIfientionaTScale "(Delay)" 
























"■.56' 
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TABLE C-2 
Study II 

Alpha Coefficients and Standard Errors of Measurement of 
Ecology Information Subtests 

PRETEST 



TREATMENT 


SAMPLE 
SIZE 


TOTAL SCALE 
(27 Items) 


INTENTIONAL 
SCALE II 
(8 Items) 


INTENTIONAL 
25% HCQ SCALE 
(7 Items) 


INCIDENTAL 
SCALE II 
(10 Items) 


Al pha 
Coeff 


Sem 


Alpha 
Coeff 


Sem 


Alpha 
Coefil 


Sem 


Alpha 
Coeff 


Sem 


25% HCQ_ 


72 


0.58 


2.23 


0.09 


1.16 


0.35 


1.15 


0.35 


1 .39 


50% HCO 


57 


0.49 


2.25 


0.29 


1.15 


0.10 


1 .74 


0.38 


1 .43 


75% HCQ 


71 


0.58 


2.24 


0.27 


1 .14 


0.14 


1.17 


0.51 


1 .36 


Art Activity II 


148 


0.54 


2.27 


0.18 


1 .19 


0.15 


1.19 


0.31 


1 .40 



POSHEST 



TREATMENT 


SAMPLE 
SIZE 

1 


TOTAL SCALE 
(27 Items) 


INTENTIONAL 
SCALE II 
(8 Items) 


INTENTIONAL 
25% HCQ SCALE 
(7 Items) 


INCID 
SCAL 
(10 11 


ENTAL 
E II 
tems) 


Alpha 
Coeff 


Sem 


Alpha 
Coeff 


Sem 


Alpha 
Coeff 


Sem 


Alpha 
Coeff 


Sem 


25% HCQ 


69 


0.80 


2.15 


0.51 


1.07 


0.38 


1 .18 


0.63 


1.32 


50% HCQ 


67 


0.76 


2.25 


0.50 


1.12 


0.47 


1 .21 


0.47 


1.40 


75% HCQ 


70 


0.83 


2.14 


0.53 


1 .03 


0.54 


1 .18 


0.69 


1 .32 


Art Activity II 


149 


0.80 


2.28 


0.51 


1.19 


0.48 


1 .20 


0.66 


1.37 



DELAYED TEST 



TREATMENT 


SAMPLE 


TOTAL SCALE 
(27 Items) 


INTENTIONAL 
SCALE II 
(8 Items) 


INTENTIONAL 
25% HCQ SCALE 
(7 Items) 


INCIDENTAL 
SCALE II 
(10 Items) 


Alpha 

CO£ff_ 


Sem 


Al Dha 
Coeff 


Sem _ 


Alpha 

Coeff 


Sem 


/I Pha 
Coeff 


Sem 


25% HCQ 


67 


0.84 


2.12 


0.68 


1.02 


0.58 


1.11 


0.63 


1 .34 


50% HCQ 


67 


0.81 


2.28 


0.64 


1.16 


0.54 


1 .21 


0.59 


1.40 


75% HCQ 


70 


0.83 


2.20 


0.70 


1 .07 


0.46 


1.19 


0.71 


1 .34 


Art Activity II 


142 


0.82 


2.29 


0.60 


1 .23 


0.51 


1 .19 


0.65 


1.38 
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TABLE C-3 
Study II 

Correlation Matrix of Oral Test Variables 



VARIABLES 


1 


2 


3 


1 . Content Scale (Pre) 








2. Logical Extension Scale (Pre) 


.69 






3. Content Scale (Post) 


.44 


.53 




4. Logical Extension Scale (Post) 


.38 


.62 


.67 



TABLE C-4 
Study II 

Correlation Matrix of Essay Test Variables 



VARIABLES 


1 


2 


3 


1 . Content Scale (Pre) 








2. Logical Extension Scale (Pre) 


.54 






3. Content Scale (Post) 


.65 


.43 




4. Logical Extension Scale (Post) 


.33 


.45 


.58 
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TABLE C-5 

Study II 
Correlation Matrix of 
(Juestion-Generating Test Variables 
(Paper and Pencil Measure) 



VARIABLES 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


I Nonpertinent Questions (Pre) 


m 




















2. Pertinent (Juestions (Pre) 


-.15 




















3. Specificity (Pre) 


.03 


.38 


















4. Requests for Rationale (Pre) 


-.08 


.11 


-.01 
















5. (juality Rating (Pre) 


-.31 


.05 


.07 


.06 














6. Nonpertinent (juestions (Post) 


.38 


.04 


.12 


-.01 


-.11 












7. Pertinent Questions (Post) 


-.12 


.62 


.16 


.12 


.04 


.18 










8. Specificity (Post) 


-.02 


.26 


.39 


.01 


.08 


.12 


.43 








9. Requests for Rationale (Post) 


-.12 


.21 


M 


.31 


.06 


-.02 


.31 


.C3 






10. Quality Rating (Post) 


-.22 


.06 


.09 


.03 


.32 


-.14 


.07 


.24 


.12 
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TABLE C-6 



Study II 

Intraclass Correlation Coefficients for 
Question-Generating Test Variables 
(Paper and Pencil Measures) 



VARIABLE 


Pretest 


Posttest 


Nonpertinent Questions 


.55 


.32 


Pertinent Questions 


.93 


.97 


Specific Questions 


.72 


.84 


Requests for Rationale 


.76 


.52 


Quality Rating 


.42 


.52 



TABLE C-7 

Study II 
Correlation Matrix cf 
Qi;e-st1on-Generating Te-t Var^'ab 3S 
(Oral Measure) 



VARIABLES 


1 


2 


3 


4 


5 


6 


1. Nonpertinent Questions (Pre) 














2. Pertinent Questions (Pre) 


- 06 












3. Quality Rating (Pre) 


-.04 


.67 










4. Nonpertinent Questions (Post) 


.13 


-.02 


-.05 








5. Pertinent Questions (Post) 


.05 


.54 


.35 


-.12 






6. Qua! ity Rating (Post) 


.13 


.30 


.35 


-.06 


.51 





273 



TABLE C-8 
Study II 

Correlation Matrix of Word Association Subscales 



— ~ J. 

VARIABLES [ 


, "1 


2 


.3 


4 


■ 

5 


6 


! 

7 1 8 


,9 


10 


n 


I 

12 


1. Balance of Mature (Pre) i 


' , 1 
i \ 

- 1 ! _ 


















■ 


2. Ecology (Pre) 


.41 




















^ 


— ■ - — ■ 


3. Alliqator (Pre) 


.18 


.12 




















1 
I 


4. Air Pollution (Pre) 


.21 


.19 


-.01 


















i 


5. Wolf (Pre) 


.24 


.19 


.62 


.11 




















6. Water Polktion (Pre) 


.19 


.14 


-.01 


.60 


.12 








i 

\ 







7. Balance of Nature (Post) 


,46 


.42 


.18 


.13 


.22 


.18 














8. Ecoloqy (Post) 


.18 


.45 


.13 


.10 


.10 


.17 


.54 








— 




9. All iqator (Post) 


.23 


.25 


.53 


.06 


.48 


.13 


.39 


.25 










10. Air Pollution (Post) 


.07 


.05 


.04 


.33 


.04 


^38 


.16 


.25 


.11 








11. Wolf (Post) 


.24 


.26 


.88 


.13 


.58 


.16 


.39 


.30 


.65 


,08 






12. Water Pollution (Post) 


.06 


.08 


.05 


.25 


-.01 


.36 


.17 


■35 „ 


.12 


.79 


.05 
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TABLE C-9 
Study II 

fl'ipha Coefficients and Standard Errors of Measurement of 
Word Association Subscales 



PRETEST 



TREATMENT 


W\ F 
SIZE 


" BALAN'CE' " 
OF 
NATURE 


ECOLOGY . 


ALLIGATOR 


AIR 
POLLUTION 


WOLF 


WATER 
POLLUTION 






Alpha' 
Coeff. 


Sem 


Alpha 
Coeff. 


Sem 


Alpha 
Coeff. 


. Seiii 


Alpha 
Coeff. 


Sem 


Alpha 
Coeff. 


Sem 


Alpha 
Coeff. 


Sem 


25% HCd 


70 


0.75 


3.87 


0.89 


3.42 


0.81 


4.46 


0.34 


3,89 


0.83 


3.92 


0.52 


3.89 


50^ HC(| . 


68 


0.78 


3.91 


0.85 


3.89 


0.77 


4.45 


0.12 


4.11 


0.73 


4.17 


0.29 


4.28 


urn 


f3 


0.81 


4.00 


0.90 


3.80 


0.76 


4.64 


0.54 


4.16 


0.78 


3.91 


0.T5 


3.95 


niL nLlIVItj ii 


142 


0.73 


4.^3 


0.81 


3.94 


0.79 


4.71 


0.40 


4.04 


0.81 


4.18 


0.45 


4.18 




POSTTEST 






TREATMENT 


SAMPLE 
SIZE 


BALANCE 

OF 
NATURE 


ECOLOGY 


ALLIGATOR 


AIR ■ 
POLLUTION 


WOL 


F 


POLLUl 


ION 






Alpha 
Coeff. 


Sem 


Alpha 
Coeff. 


Sem 


Alpha 
Coeff. 


Sem 


Alpha 
Coeff. 


Sem 


Alpha 
Coeff. 


Sem 


.Alpha 
Coeff. 


Sem 


25% HCQ 


d8 


0.85 


3.^2 


0.95 


2.70 


0.83 


3.85 


0.33 


3.9C 


0.88 


3.25 


0.38 


3.66 


50% m 


68 


0.80 


3.86 


0.89 


3.12 


0.81 


4.24 


0.62 


4.24 


0.81 


3.87 


0.68 


4.41 


HCQ 


70 


0.74 


3.47 


0.91 


2.75 


0.78 


4.24 


0.13 


4.49 


0.79 


3.76 


0.59 


4.50 


Art Activity 11 


146 


0.87 


3.77 


0.94 


2.98 


0.82 


4.52 


0.56 


4.28 


0.87 


3.98 


0.55 


4.59 



TABLE C-10 



Study II 
Correlation Matrix of 
Gall -Crown Discussion Attitude Subscales 



VARIABLES 


.1 


2 


3 


4 


1. Attitude toward Thought Questions (Pre) 


_ 








2. Attitude toward Discussions (Pre) 


.64 








3. Attitude toward Thought Questions (Delay) 


.55 


.52 






4. Attitude toward Discussions (Delay) 


.43 


.58 


.76 





TABLE C-n 
Study II 

l\^pha Coefficients and Standard Errors of Measurement of 
Gall-Crow" Discussion Htitude Subscales 



PRETEST 



TREATMENT 


SAMPLE 
SIZE 


i ATTITUDE TOWARD 
THOUGHT QUESTION 
(11 items) 


ATTITUDE TOWARD 
DISCUSSION 
(19 items) 


Alpha 
Coeff. 


Sem 


Alpha 
Coeff. 


Sem 


25% HCO 


70 


0.78 


.v2 


0.83 


3.24 


50% HCO 


68 


0.78 


2.55 


0.80 


3.22 


75% HCO 


70 


0.70 


2.74 


0.85 


3.18 
3.33 


Art Activity II 


147 


0.71 


2.69 


0.85 


DELAYCD TEST 


TREATMENT 

i 


SAMPLE 
SIZE 


ATTITUDE TOWARD 
THOUGHT QUESTION 
(11 items) 


ATTITUDE TOWARD 
DISCUSSION 
(19 items) 


Al pha 
Coeff. 


Sem 


Alpha 
Coeff. 


Sem 


25% HCQ 


69 


0.83 


2.53 


0.92 


3.11 


50% HCQ 


65 


0.83 


2.46 


0.87 


3.07 


75% HCQ 


68 


0.89 


2.31 


0.89 


3.29 


Ar* Activity II 


145 


0.83 


2.60 


0.89 


3.37 i 
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TABLl" C.-12 



Study II 
Correlation Matrix of 
Ecology Unit Opinions Subscales 



VARIABLE 


1 


2 


3 


1. Attitude u ard peers 




.48 


.48 


2. Attitude toward teacher 






.79 


3. Attitude towarc curriculum 









TABLE C-13 
Study II 

Alpha Coefficients and Standard Errors of Measurement of 
Ecology Unit Opinions Subscales 



TREATMENT 


SAMPLE 
SIZE 


ATTITUDE 
TOWARD 
PEERS 
(5 itei^is) 


ATTITUDE 
TOWARD 
ECOLOGY TEACHER 
(19 items) 


ATTITUDE 
TOWARD ECOLOGY 
CURRICULUM 
(9 items) 






Alpha 
Coeff . 


Sem 


Alpha 
Coeff. 


Sem 


Alpha 
Coeff. 




25% HCQ 


69 


0.68 


1.51 


0.90 


2.37 


0.88 4.: 3 , 


50% HCQ 


65 


0.69 


1 .50 


0.90 


2.28 


0.83 


i . yd 


75% HCQ 


70 


0.67 


1.50 


0.92 


2.46 


0.87 


1 .98 


Art Activit' II 

„ — . 


150 


0.68 


! 

1 1 .73 


0.90 


2.56 


0.87 


1 •99,._. 
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TABLE C-14 



Study II 
Correlation Matrix of 
Ecology Discussion Attitude Subscales 



f - 

VARIABLE 


1 


2 


1. Attitude toward discussion 




.80 


2. Attitude towa^^d thought questions 







lABLE C-15 
Study II 

Alpha Coefficients and Standard Errors of Measurement of 
Ecology Discussion Attitude Subscales 



TREATMENT 


SAMPLE 
SIZE 


ATTITUDE TOWARD 
THOUGHT QUESTIONS 
(11 items) 


ATTITUDE TOWARD 
DISCUSSION 
(-19 items) 


AT nha 
Coeff. 


Sem 


Alpha 
Coeff 


Sem 


25% HCQ 


69 


0.86 


2.32 


0.89 


2.99 


50% HCQ 


67 


0.87 


Z.29 


0.89 


3.08 


75% HCQ 


71 


0.89 


2.27 


0.89 


3.1° 

• 



ERIC 



2o0 



TABLE C-16 



Study II 

Alpha Coefficient and Standard ilrror of Measurement of 
Ecology Art Project Scale 



TRtATMENT 


ATTITUDE TOWARD ART PROJECTS 






(19 items) 










Standard 




Sample 


Alpha 


Error of 




Size 


Coefficient 


Measurement 


Art Activity (Posttest) 


144 


0.91. 


^95 



APPENDIX D 

Study I Descriptive Statistics: 
Measures of Student Ability, 
Achievement, Attitudes, and Attendance 



82 



TABLE 0-1 

Comprehensive Test of Basic Skills (Vocabulary, Comprehension, and Total Reading Score) 

Study I Descriptive Statistics 



ECOLOGY 
TEACHER 


PROBING AND 
REDIRECTION 
TREATMENT 


NO PROBING AND 

DIRECTION 

TRE.ATMENT 


FILLER 

ACTIVITY 

TREATMENT 


ART 

ACTIVITY 
TREATMENT I 




WRITTEN 

EKERCISE 

TEACHER 


WRITTEN 

EXERCISE 

TREATMENT 


ID 


CLASS 

N 




SO 


CLASS 

N 


i 


SD 


CLASS 

N 


J 


SD 


lASS 

N 


I 


SD 




ID 




CLASS 

N 


X 


so 


1 VUUnD 

coif 

TOTAL 


10 4 

4 


34.25 
69.25 


4.11 

\J.Cl 

6,18 


4 

1 4 
4 


26.76 

JU. 

57.25 


10.47 
23,77 


4 

9 4 

4 


29,75 
63.00 


5.56 

tin 

10.39 


3 
3 


27,33 
fiO.OO 


4,04 
6 51 
6.09 




13 


VOCAB 

COMP 

TOTAL 


2 

1 2 
2 


27,00 
26,50 
53,50 


11.31 
9,19 
20.51 


t VuUnD 

COMP 
TOTAL 


5 

6 5 
5 


25.40 
20.00 
45.40 


5,/2 
1 62 
12,68 


5 

5 5 
5 


31.80 
31.60 
63.40 


5,85 
13.94 
19.40 


3 

11 3 
3 


29.00 
28.33 
57.33 


4,35 
3,21 
115 


6 

12 6 
6 


25.50 
26.67 
52!l7 


7.97 
9,46 
17.22 




13 


VOCAB 

COMP 

TOTAL 


2 

2 2 

L 


22,50 
33,00 
55.50 


10.61 
0,00 
10.61 


<J VUtMD 

COMP 

TOTAL 


1 5 
5 


2S.D0 
30.40 
58.40 


5,24 
6 66 
11,33 


5 

10 5 
5 


23.00 
20.20 

43^20 


9.19 

5 63 
14.13 


3 

2 3 

3 


25.33 
28.33 
M 


10.02 
14.36 


5 

9 5 
5 


20.80 
26 00 
48.80 


8.55 
5.92 
12„7S 




13 


VOCAB 

COMP 

TOTAL 


5 

9 5 


25.80 

24,83 
58.80 


6.06 
10.42 
12.32 


COMP 
TOTAL 


6 

3 


29.33 
59,17 


9,75 
in 9*5 

19,7fi 


6 

7 fi 


31,00 
61,00 


782 
in 

17,03 


5 

8 

W J 

5 


23.00 

OH nn 

47.W 


9.35 

1 L.OC 

22,0? 


5 

4 n 
5 


23.80 

10 /in 


6.26 
9,45 
14,^^, 




13 


VOCAB 

CO^'IP 

TOTAL 


10 4 


27.17 
33.00 
52.00 


6.34 
6.89 
14.56 


COMP 
TOTAL 


5 3 
3 


Je.oo 

'5 33 
5i.33 


8,89 
10.50 
]9!22 


6 

11 6 
6 


30.67 
27 83 
53.50 


6,06 
9 11 

Jill 

13.84 


5 

12 5 

1 tm ^ 

5 


27,20 
26 40 
53,50 


5.12 
9 24 

13,70 


6 


NO 


DATA 




14 


VOCAB 

COMP 

TOTAL 


5 

5 5 

5 


34.00 
31.20 
65.20 


2.92 
7.60 
9.76 


COHP 
TOTAL 


5 


31.20 
62.00 


5.89 

9 47 

15,30 


6 

3 fi 
6' 


27,50 
57,17 


10,71 
4 84 

13.79 


6 

i fi 


19.00 

1 J. JU 

31,50 


12,71 
in 99 

!3.18 


4 

8 4 
4 


25.?5 
51.00 


9.00 
11.24 
19.78 




15 

1 J 


VOCAB 

COMP 

TOTAL 


0 

3 6 


30.50 
28.33 
58, ?3 


7,31 
10.69 

i7.ai 


7 WAR 

COMP 
TOTAL 


..... ^ 

J J 

5 


32.20 

JL . QU 

65.00 


4.56 
7,25 


5 

4 

5 


14.00 
U 4fl 

28,40 


8.75 

V.J \ 


6 

J u 

4 


2!'.67 
?l,i7 


8.82 
6,t)3 


4 

7 4 

4 


25.50 

% 71 
r.u, / J 

52,25 


8,02 
15.59 




15 


VOCA" 

COMP 

TOTAL 


4 

4 4 


33.25 
32,75 
66.00 


2,99 
5,91 
•2,22 


0 VLv-MO 

COMP 

TOTAL 


4 

1? n 


28, /5 
56,50 


5.97 

c on 

D.OU 

11.09 


4 
4 


23,00 
45,00 


9.13 

n on 
17.83 


26.50 

JLOU 

§7,50 


10,34 

in o'i 

mi 


4 

11 li 
4 


20,75 

17 nn 
l/.UU 

.17.7^ 


7.97 

5.48 
13.23 
WIT 
10,31 
19.60 




15 


VfiCAB 

COMP 

TOTAL 


7 

7 7 

7 


31.00 
31.14 
63,13 


6.16 
5.93 
7,25 


VUIhd 

3 COHP 
TOTAL 


5 

9 5 

5 


29.20 
29.40 
58.60 


9.55 
11.72 
21.07 


3 

2 3 

J 


33.00 
35.00 
68,00 


2.65 
3.46 

t),08 


6 

1 6 
fi 


29.67 
29.50 

fi9,17 


3.27 
6,92 
9,54 


6 

10 6 
fi 


26.83 
28.00 
54.83 




15 


VOCAB 

COMP 

WM 


4 

8 4 

4 


32,50 
32,00 
63.75 


5.74 
10,30 
15.26 


'/fir AD 

10 COMP 
TOTAL 


6 

4 6 


28.16 
30.83 
59,(]fl 


8,1 

12,22 

17.73 


5 

3 5 
5 


34.20 
37,20 

71 ;fi 


2.05 
3,96 

[i,50 


6 

7 6 
fi 


23,17 
24,83 
48,00 


10,36 
6,74 
16,88 


6 

3 6 
fi 


23.17 
21.17 
44„11 


9,l5 
8.0.f 
16.03 














VOCAB 

11 roMP 


6 

11 f 

6 


25.83 

24.50 
50,33 


7.31 
8.74 
15,76 


5 

12 5 
5 


21,00 

25,60 
46.60 


12.41 

10.46 
10.46 


6 

6 6 

6 


26,67 
27.17 

53,83 


9.48 

10,98 
13,71 


6 

5 6 
5 


27.33 
25.33 
53.57 


8.41 
11.02 
19.37 














VOCAB 
12 COMP 
TOTAL 


4 

2 4 
4 


35,25 
36.50 

/1. 75 


1.50 

2,52 
2,52 


6 

9 6 
6 


27,67 
30,50 
53.17 


3.33 
6,35 
18,49 


6 

10 6 
6 


29.33 
27.33 
56,67 


5.68 
9.05 
13,94 


5 

1 5 
.5 


29,20 
32,00 
51,20 


7,85 
8,34 

l6,08 














TREATMENT JSff^ 
EFFECT TOTAL 




29.46 
29,42 
58.85 


3.21 

'V57 
/.62 




26.97 
27.87 
54.42 


5.8b 
6,42 

12,00 




26.60 
27.26 
53.8/ 


3,37 
4,58 
7,72 




25,09 
25,47 

50.56 


2.71 
4,95 

7.23 






VOCAB 

COHP 

TOTAL 




29.30 
30,53 

59,67 


3.80 
3.16 

5.21 



TABLE D-2 



Ecology Inforniation Test (Total Scale) 
Study I Descriptive Statistics 



ECOLOGy 

TCArUCD 


PROBING AND 
REDIRECTION 
TREATMENT 


NO PROBING AND 

REDIRECTION 

TREATMENT 


FILLER 

ACTIVITY 

TREATMENT 


ART 

ACTIVITY 
TREATMENT I 




WRITTEN 

E){ERCISE 

TEACHER 


WRIl 

m 
m 


[TEN 

ICISE 

ITMENT 




ID 


CLASSI 


A 


SO 


clAss 

N 


T 


SO 


CLASS 

N 


i 


SD 


lASS 

N 


K 


SD 




ID 




CLftbS 

N 


J 


SD 


1 PRE 
POST 
flELAY 


6 

10 5 
_i. 

6 

u 

6 6 
5 


10.1/ 
14,40 
13.6? 


2.40 
7.50 
6,12 


6 

1 6 
6 


11,33 
18.00 
15.67 


3,56 
6.75 
6. '62 


6 

9 6 

6 


7,33 
11.17 
10.67 


1,75 
2,86 
M5 


6 

2 6 
5 


111. 50 
13,33 
li',33 


2.81 
3.56 
4,08 




13 


PRE 

POST 

DELAY 


3 

1 3 
3 


8,00 
13,33 
13.33 


3,60 
3.05 
/,23 


...Ji'ltilL., 

POST 
DELAY 


10,17 
8.00 


1.67 
2^04 
4.64 


6 

5 6 

6 


10,50 
15,50 
9.83 


1,38 
3,27 
6,68 


6 

11 6 
5 


10.50 
15.50 
,16.80 


2,74 
7,03 
5.89 


7 

12 7 
5 


8.86 
8.29 
6.00 


1,57 
3.15 

1,87 




13 


I'RE 

POST 

DELAY 


2 

2 3 

3 


12.00 
13.67 
13.57 


2,82 
5,03 
4.16 


3 PRE 
POST 

DFLAY 


6 

1 5 
6 


roi7 

12,67 
13,83 


2.48 
5.24 
5.04 


6 

10 6' 
6 


7.50 
8.83 
8.00 


2.07 
4,26 
2,76 


5 

2 5 
6 


8.00 
10.83 
10,§3 


2.74 

5,13 
3,55 


5 

9 6 
5 


9.33 
8,17 
8,50 


2.94 
2,-' 

1,„ 




13 


PRE 
POST 

mi 


5 

9 5 
5 


10.60 
12.40 
11,20 


4,39 
7.09 
4,82 


. l/LLnl - 

4 PRE 
POST 

nn AY 


6 

3 • 

u 


10,50 
12!83 
12,50 


2.43 
6,65 
5.75 


0 

7 6 

6 


11.17 
18.17 
15,83 


3,76 
4,02 
5.67 


6 

8 6 
5 


8.50 
9,33 
9,?!1, 


3.02 
2,73 
2./0 


5 

4 4 

5 


8,80 
8,50 
/JO 


3.83 
3.73 
3.29 




13 


PRE 

POST 

DELAY 


8 

10 7 
8 


10,00 
11.57 
10./5 


3.50 
5.33 
4.13 


5 PRE 
POST 
[i'lflY 


U 

5 6 
5 


7 K\ 

9.33 
11.40 


1 17 
5,20 
3,85 


11 6 
6 


11.17 
16.00 
1J,S3 


2 48 
4.20 

4,1/ 


6 

12 5 
5 


8.50 
11,20 
/,00 


2,25 
3.35 
5,57 


6 


NO 


DATA 




14 


PRE 
POST 


4 

5 4 
5 


10.50 
14.25 
11,20 


2.52 
3.86 
/,8S 


6 PRE 
POST 
npi AY 


c 

D 

/ 6 
6 


n fi7 

11,0/ 

16.17 
14.0? 


J* jU 

6.04 
5,93 


u 

3 4 

5 


1) 57 
16.25 
14,60 


2 66 
8.13 
4,56 


6 

4 6 

! 


8.50 
13,17 
10,/5 


3,02 
5.98 
4,11 


5 

8 5 
5 


7.80 
10.00 

10,20 


2.77 
6,20 
5,80 




15 


PRE 

POST 

DELAY. 


5 

3 6 

4 


10.20 
17.33 
18,25 


1.79 
2.50 
2,63 


UtLttL- 

7 PRE 
POST 
DELAY 


D 

8 6 

r 
J 


13.33 
12,S0 


L.U/ 

5,43 
5,12 


4 

4 5 

4 


7 25 
0.66 
11.00 


1,71 
3,14 
2.15 


6 

3 5 
6 


10.33 
17.00 
15,00 


2.66 
4.53 
4.90 


5 

7 5 

6 


9.00 

10.17 
8,6/ 


3.80 
3,19 
3.39 




15 


PRE 

POST 

25tAY 


5 

4 5 
5 


4.20 
6,60 
3,fO 


2.49 
2.70 
2,35 


8 PRE 
POST 
DELAY 


D 

12 6 

5 


Q X\ 

13,83 
9.80 


) 1 L ) 

'3,76 
2,77 


ft 

6 6 

6 


9 17 
12,33 
11.00 


3.66 
6,28 
7.82 


6 

5 5 
4 


9.83 
14,20 
15,50 


1,47 
3.70 
2.65 


7 

11 7 

7 


6.00 
12.15 
11.00 


2.58 
2.79 
4.65 




15 


PRE 
POST 

m'i 


10 
7 10 
8 


9.50 

14."0 
13.63 


1,96 
2.62 
5,04 


9 POST 
DELAY 


6 

9 6 
5 


10.00 
15.50 
14,40 


4,56 
7,34 
6,95 


6 

2 6 


9.67 
16,83 
15,17 


3.33 
3.31 
4,49 


6 

1 6 


10,33 
17,50 
l/,50 


2.33 
3,27 
3,5/ 


5 

10 5 
6 


9.20 
9.20 
2,00 


1.92 
1,64 

?.?/ 




15 


PRE 
POST 

nn nv 
DLLflT 


7 

8 7 

/ 


9.86 
12.14 
8.71 


2.73 
6.49 
3.P4 


m 

10 POST 
DELAY 


6 

4 6 

5 


9.67 
17.33 
19,40 


3,93 
5.43 


6 

8 6 
5 


10.16 
13.67 
13,00 


1.60 
2.88 
3,32 


6 

7 6 
6 


10.00 
12,50 
10,OQ. 


3.41 
3,62 
6.3fi 


6 

3 6 
' 5 


8.17 
10.33 
B.OO 


2.40 
3,33 
4.18 












- — 


PRE 

11 POST 
DELAY 


6 

11 5' 

6 


12.00 
15.00 
13.1/ 


2,45 
6,07 
5,25 


5 

12 4 


9,40 
13,00 

U 


3.21 
4.59 
4„05 


5 

6 6 
6 


9,20 
14.33 
11,83 


■1.54 
6,25 
5.42 


6 

5 6 
6 


7,17 
5,50 
,9.00 


1./2 
2.43 
2.10 














PRE 

12 POST 
DELAY 


() 

2 6 
6 


10,50 
15.50 
15.00 


4,85 
6.38 
7,95 


6 

9 5 
6 


10.00 
11,00 
7,50 


2.53 
6.48 
5,/9 


6 

10 6 


lO.OO 
10,83 
9,80 


2.S0 
5,49 
4.81 


6 

1 6 
5 


12.83 
13.67 
14,00 


3.76 
7.71 
/,82 














TREATMENT PRE 
POST 

EFFECT DELAY 




9,85 

13,92 
13.16 


1.40 
2.44 
0.90 




9.75 
13.85 
12,03 


1,32 
3,64 
3.03 




9,25 
13,13 
12.11 


1.06 

2.62 
3.29 




9.06 

10.30 
9,39 


1,54 
1.94 
2,16 






PRE 
POST 
3ELAY 
1 




10.14 
13.83 
12.24 


1.07 

1,80 
2.88 



230 



ERIC 



TABLE D-3 

Ecology Inforaation Test (Intentional Scale I) 
Study I Descriptive Statistics 



1 


PROBING AND 


NO PROBING AND 




FILLER 






ART 






WRITTEN 


WRITTEN 




ECOLOGY 


REDIRECTION 


REDIRECTIOfI 






ACTIVITY 




ACTIVITY 




EXERCISE 


EXERCISE 




TEflCHEP, 


TREATMENT 




TREATHENT 






TREATHENT 




TREATMENT I 




TEACHER 


TREATMENT 




ID 




I 

M 


cn 
iU 


CLASS 

N 


I 




CLASS 

N 


I 


SD 


ILrtSS 

N 


I 


SD 




ID 




n 

N 


I 


SD 


1 PRE 


6 


4.17 


1.33 


6 


3.83 


0.98 




6 


3.33 


1 r A 

1.50 


6 


3,6' 


1.75 






PRE 


3 


2.00 


1.00 


POST 


in r 
ID 5 


7.20 


3.35 


1 6 


7.33 


3.14 


9 


6 


5.83 


1.33 


2 6 


t rn 

5.50 


0*84 




13 


POST 


1 3 


D.33 


0,58 


, 


5 


6.67 


2.66 


6 


T on 

7.00 


3.35 




6 


5.83 


2.04 


6 


4.0/ 


1.03 






DELAY 


j 


O.OU 


2.55 


Z PRE 


6 


1.67 


1.21 


6 


3.33 


1.37 




6 


4.33 


1 IC 

1.75 


7 


.'r.29 


0.95 






PRE 


I 


5.50 


O./l 


POST 


0 6 


5.33 


1.63 


5 6 


6.83 


1.47 


11 


6 


7.00 


3.10 


12 7 


J. 43 


1*51 




13 


POST 


2 3 


,6.33 


1.53 


DELAY 


5 


U\ 


2,]S 


6 


3.50 


2.74 




5 


7.00 


1,87 


5 


2.20 


1 no 

1.92 






DELAY 


3 


D.33 


2,08 


3 PRE 


6 


3.50 


0.84 


6 


3.33 


1.21 




5 


3.20 


1.92 


6 


3.33 


1.50 






.PRE 


5 


4.40 


2.30 


POST 


1 6 


5.83 


1.94 


10 6 


4.00 


2.82 


2 


6 


6.1? 


1.83 


9 6 


3.00 


1 41 

1.41 




13 


POST 


A r 

9 5 


4.60 


3.05 


, DELAY 


-.X. 


,7.00 




J 


,3,33 


1.63 




6 


5.83 


2,14 


,6 


2,50 


0,84 






hpi 111 

DELAY 


5 


J. 60 


2.61 


4 PRE 


6 


4.00 


0.63 


6 


4.00 


1.09 




6 


3.67 


2.07 


5 


4,20 


2.59 






PRE 


8 


4.25 


2.05 


POST 


i 6 


5.17 


3.11 


7 6 


8.00 


1.55 


8 


6 


3.83 


0.98 


4 4 


3.00 


1.83 




13 


RAPT 

POST 


in 

10 7 


5.57 


1.99 


, DELAY 


$ 


5t33 


2,60 


h 


6,67 


2,42 




5 


4.60 


2.07 


5 


3.60 


2,07 






DELAY 


8 


3.88 


1.46 


5 PRE 


6 


3.33 


1.03 


6 


3.83 


0.75 




6 


2.67 


1.50 












PRE 


4 


4,25 


1.26 


POST 


5 6 


4.00 


2.28 


11 6 


7.17 


1.83 


12 


5 


5.00 


2.12 


6 


NO 


DATA 




14 


POST 


5 4 


6.75 


1.89 


DFIAY 


, ,5 




l.?5 


.. .6-. 


,.yi. 


],^7 




5 




JiL 












ILM. 


5 


5.20 


3.11 


6 PRE 


6 


4.17 


1.33 


6 


3.67 


1.37 




6 


3.17 


1.60 


5 


3.20 


0.84 






PRE 


5 


4.00 


1.6/ 


POST 


1 6 


7.00 


1.55 


3 4 


6.25 


3.30 


4 


6 


5.85 


2,40 


8 5 


4.40 


2.30 




15 


POST 


3 6 


8.00 


1.41 


nriAv 




5.67 


2.73 


5 


14.60 


4.56 




4 


4,75 


J.ZL 


5 


J.2(L 








DELAY 


4 


7.75 


1,26 


1 PRE 


6 


4.00 


1.27 


4 


3.25 


1.50 




6 


4.67 


1.97 


5 


3.60 


0.89 






PRE 


5 


10.60 


4.10 


POST 


8 5 


5.00 


2.97 


4 6 


3.17 


1.17 


3 


5 


8.00 


0.71 


7 6 


4.33 


1.60 




15 


POST 


4 5 


15.60 


5.18 


DELAY 


5 


6.00 


1.87 


4 


4.00 


0.00 




6 


7.00 


1.26., 


6 


4.17 


.1,47 










,.ajo 


5,02 


8 PRE 


6 


3.50 


1.64 


6 


3.83 


2.04 




6 


4.17 


1.33 


7 


3.14 


1.68 




m 


10 


4.00 


0,94 


POST 


12 6 


5.83 


2.40 


6 6 


5.50 


2.88 


5 


5 


6.40 


2.70 


11 7 


3.71 


1,38 




15 


POST 


7 10 


6.20 


1.03, 


DELAY 


5.. 


^.211. 


1.S2 


, 6 


5.17 


3,37 




4 


7.00 


0.82 


7 


3.71 


i.as. 






Ml 


. 8 


5.75 


2.38 


PRE 


6 


3.17 


1.33 


6 


3.67 


1.03 




6 


3.50 


0.84 


5 


4,00 


0.70 






PRE 


7 


3.57 


.0.79 


9 POST 


9 6 


7.00 


3.52 


2 6 


7.17 


1.60 


1 


6 


8.17 


1.47 


10 5 


4,80 


2.28 




15 


POST 


8 7 


5,43 


3.31 


DELAY 


5 


6,00 


3.24 


6 


6,?J 


1,60 




6 


7.83 


,0.t 


6 


.3,33., 


.],.§£-., 






Ml 


] 


4,29 


],?0 


PR^ 


6 


3.83 


1.47 


6 


3.57 


1.03 




6 


4.67 


1.03 


6 


3.17 


1.33 














10 POST 


4 6 


7.00 


2.61 


8 5 


6.67 


2.50 


7 


6 


6.00 


2.10 


3 6 


4.33 


1.37 














DELAY 


5 


8.40 


1.95 


5 


m 


2,2? 




6 


4.50 


3.27 


"5 


3.40 


1.52 














PRE 


6 


4.33 


1.37 


5 


3.40 


1.52 




5 


3.00 


1.58 


6 


3.00 


1.67 














11 POST 


11 6 


7.17 


2.04 


12 4 


5.25 


2.63 


6 


6 


6.50 


2.81 


5 6 


3.50 


1.22 














DELAY 


6 


6.17 


2.48 


5 


3,40 


2,51 




6 


5,67 


2.07 


5 


3.50 


1.76 














PRE 


5 


4.17 


1.47 




4.17 


1.47 




6 


3.66 


1.86 


6 


5.00 


0.89 














12 POST 


2 6 


6.83 


2.86 


9 5 


4.60 


2.30 


0 


6 


4.50 


3.39 


1 6 


6.17 


2.99 














DELAY 


6 


6.33 


2.88 


6 


2,50 


2.5S 




5 


5,60 


2,60 


6 


5,67 


2,73 














TREATMENT pgE 




3.65 


0.73 




3.66 


0.29 






3.67 


0.66 




3.60 


0.60 






PRE 




4.06 


0.93 


POST 




6.20 


1.01 




5.99 


1.49 






6.10 


1.28 




4.33 


1.02 
1.00.. 






POST 




6.20 


0.95 


EFFECT DELAY 




5,71. 






5,H 


1.68 






5.11 , 


.li 




3.S1 






DELAY 




5.15 


1,43 



TABLE D-4 

Ecology Information Test (Incidental Scale I) 
Study I Descriptive Statistics 



r — 

ECOLOGy 
TEACHER 


PROBING AND 
REDIRECTION 
TREATMENT 


NO PROBING AND 

REDIRECTION 

TREATMENT 


fILLER 

ACTIVITY 

TREATMENT 


ART 

ACTIVITY 
TREATMENT F 




WRIHEN 

EXERCISE 

TEACHER 


WRIl 
EXEI 

TRFI 


rTEN 
ICISE 

iTMFMT 




ID 




I 


SO 


CLASS 

N 


I 


SO 


CLASS 

N 


l 


SD 


lASS 

N 


I 


SD 




ID 




LLASS 

N 


J 


SD 


1 PRE 
POST 
DELAY 


6 

10 5 
5 


G.Of 
7.20 
7.00 


2.45 

4.32 
4.01) 


6 

1 6 
6 


7.50 
10.67 
8.67 


2.88 
3.78 
3.61 


6 

S 6 
6 


4,00 
5.33 
4.83 


0.90 
2.16 
0.75 


6 

2 6 
6... 


6.83 
7,83 
6,67 


1.72 
3.06 
3,2/ 




13 


PRE 

POST 

DELAY 


3 

1 3 

J 


6.00 
7.00 

7 1"^ 
/ . jj 


4.00 
2.65 

4 fi? 


I PRE 
POST 
DELAY 


6 

6 6 
5 


5.33 

m 

4,60 


0.82 
1.47 
;!,61 


5 

5 6 
6 


7.17 
8.67 
6,33 


0.98 
2.25 
4,13 


6 

11 6 
5 


6.16 
8.50 
9.80 


2.40 
4.27 
4.76 


7 

12 7 
5 


5.57 
4.86 
3.80 


2.22 
2.48 
1.30 




13 


PRE 

POST 

DELAY 


2 

2 3 

•3 
0 


5.50 
7.33 

/.J J 


2.12 
3.51 

9 Oft 


3 PRE 
POST 
DELAY 


1^ 

6 


6.57 

6.83 
6,83 


2.73 

3.76 
107 


6 

10 5 
6 


4.17 
4.83 
4.67 


1,72 
2.55 
1-21 . 


5 

2 6 

6 


4.80 
4.67 

5,.oo 


2.17 
3.83 

2.10 


6 

9 5 
6 


6.00 
5.17 
6.00 


1.55 
1.47 
1,55 




13 


PRE 

POST 

DELAY 


5 

9 5 


6,20 

7.80 
7 60 


3.03 
4.32 
2 61 


4 PRE 
POST 
DELAL, 


6 

3 6 
6 


5.50 
7.67 
7.17 


2.26 
3,83 
4.4T 


6 

7 5 
fi 


7.17 
10,17 
9.17 


2.71 
3.13 
3.75 


6 

5 6 

,5 


4.83 
5.50 
5.(10 


1,47 
2.35 
1.00 


5 

4 4 
5 


4.60 

5.50 

4.00 


1.82 

2.08 
3.32 




13 


PRE 

POST 

DELAY 


8 

10 7 
0 
0 


5.75 
6.00 

DO 


2.38 
4.28 


5 PRE 
POST 

DELJ\Y 


6 

5 5 
5 


4.50 

5.33 
8.00 


0.55 

3,56 
2,92 


5 

li 5 
6 


7.33 
6.83 
7,50 


2.50 
2.99 
2,43 


6 

12 5 
5 


5.83 
6.20 
3.40 


1.72 
2.05 
2.41- 


6 


NO 


DATA 




14 


PRE 
POST 

m 


4 

5 4 

C 

J 


6,25 

7,50 
h no 


1.71 
2.08 


S PRE 

POST 

DFLAY_ 


6 

7 6 
6 


7.50 

9.17 
8.33 


2,43 
4.96 
4,32 


5. 

3 4 


5.C0 
10.00 


2.19 
5.72 
3,29 


6 

M 


5.33 


1.63 

1:1 


5 

'\ 


4.60 
5.4! 


2.30 
4.16 
4.0Q 




15 


PRE 

POST 

DELAY 


5 

4 


5.80 
9.33 


2.68 
2.42 


1 PRE 
POST 
DELAY 


6 

8 6 
5 


5.50 
7.33 
6.80 


^.59 
3.44 
3,35 


4 6 
4 


4.00 
3.50 
7.00 


0.82 
2.35 
2.16 


6 

3 5 
6 


S!6'' 

9.00 
8.00 


1.66 
4.24 
3.79 


5 

7 6. 
6 


5.33 
4.50 


3.46 
2.42 
2.41 




15 


PRE 
POST 

m. 


5 

4 5 

C 

, J 


9.00 

^ fin 


1.82 
2.65 


8 PRE 
POST 
DELAY 


6 

12 6 
5 


5.8S 
8.00 
5.50 


0.7S 
\79 
2.19 


6 

6 6 
6 


5.33 
6,83 
5.83 


2.80 
3.97 
4.07 


6 

5 5 
4 


5.67 
7,80 
8.50 


1.03 
1.92 
2.08 


7 

11 7 
7 


4.86 
7.43 
6,29 


1.46 
2.37 
3.09 




15 


PRE 
POST 

DELAr 


10 
7 10 

Q 
0 


5.50 
8.00 

7 flfi 
/ .00 


1.90 
2.16 

3.L3 


m 

9 POST 
DELAY 


- S 


"5:83 
8.50 
8.40 


3.13 
4.04 
3.78 


fi 

2 6 
6 


m 

9,67 
8.33 


J.ib 
1.97 
2.94 


■ fi 

1 6 
6 


6,83 
9.33 
9.67 


2.22 
2.34 
2.73 


5 

10 5 
6 


5.20 
4.40 
5.67 


1.48 
1.52 
0.82 




15 


PRE 

POST 

DELAY 


7 

8 7 

7 
1 


6.29 
6.71 


2.43 
3.86 

1 Qfi 

1 «70 


m 

10 POST 
DELAY 


f 

4 

5 


5.83 
10,33 
11.00 


2.94 
1.58 


fi 

8-6 
5 


fi.fio 

7.00 
6,20 


U2 
1.10 
1.79 


6 

7 6 
? 


5.33 
6.50 
5.50 


2.65 
2.51 
?,?? 


'6 
3 6 

5. 


5.00 
6.00 
4.60 


1,41 
2.68 
4.16 














PRE 

11 POST 
DELAY 


6 

11 6 

6 


7.67 
7.83 
7.00 


1.37 
4.07 
3.J0 


5 

12 4 

5 


5.00 
7.75 
5,60 


1.87 
2.63 
I, §2 


5 

6 6 
6 


6.20 
7.83 
6,1/ 


4.49 
3.66 
3.S6 


6 

5 6 
6 


4.17 
6.00 
5.50 


1.33 
1.79 
1./6 














PRE 

12 POST 
DELAY 


6 

2 5 
5 


6.33 
9.67 
8.67 


3.67 
3.93 
5,35 


6 

9 5 
6 


5.83 
6.40 
5,00 


1.33 
4.22 
3.66 


6 

10 6 
5 


6.33 
6.33 
4.20 


1.85 
2.73 
2.77 


6 

1 6 
6 


7.83 
7.50 
fi.33 


3.19 
5.82 
5,28 














TREATHEHT PRE 

s POST 
mHCT DELAf 




6,21 
7.72 
7.45 


0.90 
1.61 
1.52 




6.08 
7.86 
6.89 


1.16 
2.23 
1.51 




5,28 
7.03 
?.34 


0.78 
1.61 
2.14 




5.46 
5.96 
5.58 


1.08 
1.14 
1.32 






PRE 
POST 

DELAY 




6.08 
7.83 

7.08 


0.33 
1.06 

1.68 



TABLE 0-5 



Oral Test (Content Scale) 
Study I Descriptive Statistics 



ECOLOGY 
TEACHER 



PROBING AND 
REDIRECTION, 
TREATMENT 



! SD 



w 

POST 



10 



■5' 
3! 



7.B3 



2.85 
0.58 



PRE 
POST 



6; 6.58 
4^ 9.75 



PRE 
POST 



6.50 
7.83 



2.27 
0.65 



1.52 
2.04 



NO PROSING AND 

REDIRECTION 

TREATMENT 

CLASS ■ - ■ " 
M I SD 



6 10.17 



1.66 
2.75 



4.50 
6.30 



2.83 
2.08 



11 



10 



6.25 
7.08 



3.66 
2.40 



FILLER 

ACTIVITY 

TREATMENT 

CLASS T^', 
N' X ' St) 



k\ t i SD 



9 



6 5.92 

5 i 7.80 



2.67 
3.51 



5.30 
6.80 



i.92 
1.92 



12 



5.83 

8.''2 



3.62 
3.18 



m 



ACTIVITY 
TREATMENT I 



6.30 
6.30 



2.35 
2.52 



5!4.2D 



1.57 
2.00 



6.20 
7.75 



2.08 

1,81 



EXERCISE 
TEACHER 

ID I 



lASS-^T 



13 



PRE 
POST 



13 



PRE 
POST 



13 



:PRE 

'POST 



WRITTEN 

EIERCISE 

TREATMENT 



3 i 9.50 
3 110.83 



5.50 
7.50 



5 : 6.90 
4 I 6.25 



SD 



0.50 
2,36 



2.83 
1.32 



1,78 



PRE 
POST 



6.83 



1.17 
2.34 



6 5.52 
6 8.33 



1.20 
3.17 



4 



5.40 
5.00 



i.79 
1.47 



6,13 
5.50 



1.93 
3,38 



13 



PRE 
POST 



10 



7 j 6.64 
7 ! 6.50 



2.23 



10 



11 



12 



PRE 

POST 

PRE 

POST 

PRE 

POST 



4.30 
6.42 



7.38 
9.83 



0.97 
1.43 



11 



4, 6.38 
3! 7.83 



1.70 
2.47 



12 



516.40 , 2.10 
6 '6.67 , 1.66 



NO iDATA 



2.78 
1.17 



6.25 
9.60 



4.29 
2.22 



3 



3.83 
5.92 



3.75 
2.71 



3.38 
3.20 



0.75 
2.31 



5.75 
8.75 



2.81 
2.77 



7.50 
7.25 



0.71 
2.99 



6:5.25 
6 J 7.75 



1.99 
1.70 



6.20 
6.75 



2.31 
3,13 



PRE 
POST 



12 



4.63 
7.25 



3.40 
2.90 



5.60 
8.50 



1.19 
1.06 



5.40 
8.00 



1.79 
3.13 



11 



4.00 
6.50 



2.18 
2.05 



PRE 
POST 



7.90 
5.50 



1.85 
2.55 



5.80 
7.42 



1.44 
1.69 



6:7.83 
6 i 8.92 



2.07 
2.08 



10 



7.80 
9.10 



PRE 
POST 



5.70 
9.13 



3.96 
0.75 



5.60 
3.50 



1.52 
2.12 



6.33 
8.33 



1.17 
2.54 



6^5.75 
6 '5.75 



3.21 
3.58 



2.04 
2.64 



PRE 
POST 



n 



6.30 
9.42 



PRE 
POST 



TREATMENT PRE 
EFFECT POST 



11.50 



6.30 
8.67 



2.02 
2.76 



12 



3.17 
7.50 



1.35 
4.10 



1.33 
1.42 



5.86 
9.99 



2.75 
2.37 

3.31 



6.17 
7.58 



10 



1.27 
2.67 



m 

8.70 



5.94 
lii 



3.33 
3.11 
TOT 
1.60 



5.30 
6.40 



1.92 
1.52 



1.07 



6.10 



5.48 



3.52 



1.27 



291 



14 



PRE 



2 ■ 7.25 



1.77 
Ml 



15 



PRE 
POST 



15 



PRE 
POST 



7.30 

m 



1.10 

2.32 



7.83 
9.00 



2.31 
3.02 



15 



PRE 
POST 



10 



5.78 
7.15 



1.52 
2.95 



15 



PRE 
POST 



5.7012.25 
6.71 !2.81 



PRE 
POST 



6.93 
7.62 



1.26 
lii 



IS) 

o 



EKLC 



TABlE D-6 



Oral Test (Logical Extension Scale) 
Study I Descriptive Statistics 




TABLE D-7 

Cssay Test (Content Scale) 
Study I Descriptive Statistics 



ECOLOGY 
TEACHER 

lU 


PROBING AND 
REDIRECTION 
TREATMENT 

cass ■"-"'^ 

fir X ' SD 


NO PROBING AND 

REDIRECTION 

TREATMENT 


FILLER 

ACTIVITY 

TREATMENT 

■CLASS ■ z^"r ' 

N X ' SD 


. ART ■ 
ACTIVITY 
TREATMENT I 




WRITTEN 

EXERCISE 

TEACHER 


WRITTEN 

EXERCISE 

TREATMENT 


CLASS 

N 


I SD 


n| X i SD 




ID 




IA5S _ 
I I 


SD 


I PRE 
POST 


in 5 8.25 
6' 9.25 


5,86 
4.37 




12.67^ 3.50 
14.00 ! 4.04 


0 6,12.33 ;3.44 
^ 61 7.25 1.63 


■ 6j 12.67! 3.13 
^ 61 12.08! 3.34 




13 

IPOST 


, 3no.83 
' 3 ■11.67 


1.61 ' 
2.08 


2 PRE 
POST 


^ 5^1.80 


3.71 
12.28 




8,90 
0,25 


3.27 
3.37 


6!11.33 2.58 
" 6'12.50 4.38 


6! ^..00 
7! 7.42 


4.44 
4.29 




13 '^^^ 
POST 


, 3 ■ 8.00 
^ 2' 7.25 


2.65 
0.35 


3 PRE 

POST 


, 510.50 
' 6 12.25 


1.97 
4.32 




5.58 
7.08 


2.96 
4.61 


, 510.50,3.34 
^ 6H.42 3.96 


, 6 7.50 
^ 6i 6.00 


2.79 
2.97 




13 

'■^ POST 


, 5.11.40 
^ 4 • 6.63 


3.77 
3.01 


4 PRE 
POST 


, 6 8.83 
610.50 


3.64 
6.75 




0,42 
3.50 


4.85 
5,59 


6i 5.92 4.08 
° 6! 8.25 4,22 


^ I 


6.00 
4.30 


3.32 
3.37 




PRE 
POST 


in 8' 8.56 
10 7 i 8.64 


4.80 
3.63 


5 PRE 
POST 


r 6 7.00 4.00 
^ ^ 7.25' 4.72 




1.50 2.88 
1,60 ' 1.71 


4j 3.63 '2.90 
5l8.10i.l9 


6 


NO IDATA 




'POST 


, 4 8.00 
5 4il0.l3 


4.42 
5.04 


6 PRE 
POST 


7 611,751 2.04 
6 12.331 3.09 


4 


1,25 ; 3.63 
2.13 ' 3.35 


. 6 5.0013.54 
^ 5 6.40:3.29 


Q 5i 9.90! 5.28 
^ 5 9.50! 3.82 




PRE i, 6; 11.25 2.81 
POST:^ 6110,00 1.05 


/ PRE 
POST 


. 611.42! 6,16 
^ 5 12.90! 6.77 




6.60 ' 3.11 
5.20 ' 4.16 


, 6,10.67 
^ 6: 8.75 


4.30 
5,91 


, 5i 7.80' 2.68 
' 6i 10.08' 2.73 




15 

POST 


4 

' 5 


10.88 /.39 
10.20 5.09 


8 PRE 
POST 


,p 6 8.08! 3.12 
^ 610.42' 2.29 




5.88 ' 4,15 
0.25 ^ 4.13 


, 6i9.17i4,25 
^ 4 10.25^4.87 


6^ 5.75' 6.03 
" 6! 9.001 4.11 




K PRE 
POST 


, iono.oo'4.zi 

' 10 '12.20 3.87 

" X In '111 A 'X'A"'- 


9 PRE 
POST 


Q 6 11.58 4.77 
^ 6 9.92 3,46 




0.83 2.54 
2.33 ' 3.06 


. 5:11.60:1.92 
' 6ill.25:3.03 


in 5| 9.30 
10 5; 9.40 


2.28 
1.08 




'PRE 

!post 


^ 6 


11.9^ Z.Ji! 
11.42 i 2.78 


10 PRE 
POST 


. 6 8.75 3.08 
^ 6 9.83: 1.61 




1.60 3.56 
2.00 2.57 


, 150:2.44 
' 6 10.75 4.49 


, 6! 10.50 
^ 6' 7.75 


]i;58 
6.01 












11 PRE 
POST 


6 8,58 j 4.05 
" 612.42i 4.72 




7,33 
8,75 


5.64 
3.71 


, 6 $.08 '3.84 
^ 6 11.42 13.09 


^ 6 5.75 
5 6. 7.08 


2 95 
2.56 






\^ : 1 


1 






12 PRE 
POST 




11.50 
13.10 


3.13 
1.78 




0,42 
2,10 


2.52 
3.23 




9.42 
11.17 


3.12 
3.62 


' 6 


9.20 
10.50 


4.59 
4.51 












1.53 
1.94 


TREATMENT PRE 
EFFECT POST 




y.bi) 

11.00 


l.biJ 
1.76 




9.41 
10.77 


2.46 
2.62 




8.93 
9.79 


2.75 
1.95 




8,40 
8.46 


2.18 
2.21 






PRE 
POST 




10.09 
9.79 



TABLE D-8 

Essay Test (Logical Extension Scale) 
Study I Descriptive Statistics 



ECOLOGy 
TEACHER 


PROBING AN 
REDIRECTIC 
■TREATMENT 

CLASS 

N; ^ 


D 
N 

SD 


i PROBING AND 
REDIRECTION 
TREATMENT , 

CLASS - 
i I SD 


FILLER 

ACTIVITY 

TREATMENT 

'CLASS ■ 

N^ X ' SD 


ART 

ACTIVITY 
TREATMENT I 

n! X ' 




WRITT 
EXERC 
TEACH 

1 

ID 


EN 
ISE 

ER ; 


WRITTEN 

EXERCISE 

TREATMENT 

Mrt'_ 

N| X 


SD 


POST 


6 1.25 


1.75 
1.41 


7 gl.yV 1734 
' 6 2.08' 1.24 


9 ..6, 1.58 
^ 6l 0.58 


1.96 
1.20 


ii 


2.25 
1.08 


1.73 
1.50 








1.50 |1.00 
?,00 ,0.50 , 


1 FT" 

POST 


^ ^ 0.75 


0.'94 


, 6 0.581 
^ 6: 2.17 


0.58 
2.01 


511.42: 1.86 
" 6' 1.75,1.64 


7 

7 


0.36 iO.63 
0.50 10.50 . 




,0 1 PRE 
POST 




1.33 


0.76 
0 5fi 


3 PRE 
POST 


' 6 2.25 


1.08 
1.75 


in 6 0.33 
6 0.75 


0.41 
0.88 


, 5; 2.83 3.04 
^ 6 0.67 1.08 


Q 6,0.83 10.41 
^ 6!0.75|0.69 




13 ^^^^ 
POST 


5 


l.bU ,l.i5^ 

0.70 iO.76 


4 PRE 
POST 


, 5 1.58 
^ ^ 1.57 


2.13 
1.83 




0.83 
2.d5 


0.98 
1.66 


. 6' 0.17 0.26, 
° 6i 0.75 0.99 


. 5 0.70 0.84 
^ 5io.lOiO.22 




13 

POST 




1.56 2.23 
0.94 ,0.98 


5 PRE 
POST 


. 6 0.92 
^ ^ 1.17 


1.15 
0.82 




0.83 0,68 
0.67' 0.61 


,„ 6^0.25 0.61 
6' 1.00,1.22 


6 , 


NO DATA 




14 

: POST 


5 ' 
' 5 


0.80 0.57 
0.40 0.42 


6 PRE 
POST 


7 6 1.33 
' 5 1.75 


0.68 
0.94 




2.33 
2.00 


2.86 
2.07 


' I 


0.33 i0.61 
0.2510.27 




1.00 ll.OO 
r.20 1.26 




POST 


b, 1.511 I.IO 

' 6|0.?5 0.76 


7 m 

POST 


, 5, 0.75 
^ 6 1.50 


0.76 
3.21 


' I 


0.50 
0.25 


1.00 
0.61 




3.17 13.71 
■.58;].74 




0.92 0.97 
1.25 '0.82 




:PRE 
jPOST 




i.yu j.uo 
0.70 0.84 


8 PRE 
POST 


6 0.83 
6 1.25 


0.S3 
1.21 


^ 6 


0.00 
1.08 


0.00, 
1.50 


. J (1.92 10.80 
^ 6 1.42 '1.69 


.. 7 0.36 0.95 
" 7| 0.50 '0.71 




15 


PKt 
POST 


' 10n.65 1.40 


9 PRE 

POST 


. 6 1.75 1.92 
^ 6 1.00, 1.14 


2 ^ 
^ 6 


]M' 1.]] 
1.00 1.22 




2.25. 1.92 
1.25 J. 04 


10 III 


1.40 
0.98 




15 


PRE 
POST 


'I 


I.DU 

0.88 


\.cu 
1.46 


10 PRE 
POST 


. 5 0.17 
^ g 0.58 


0.41 
0.49 


3 5| 0.92 1.55 
" 6^ 0.92, 1.28 




1.08 :0.86 
1.42 0.86 




2.08 
0.67 


4.62 
1.40 














11 ^^t 
POST 


0.6? 

" 6 2.17 


0.41 
1.92 


12 ^ 


0.50 
0.75 


1.22 
0.61 




1.00 
1.00 


0.84 
0.71 




0.42 
0.25 


0.66 
0.61 












■ 12 PRt 
POST 




2.75 
1.08 


0.86 
0.86 


^ 6 


1.25 
1.00 


0.61 
1.14 




0.25 
1.08 


0.42 
0.97 


' I 


1.42 
1.67 


1.20 
1.72 














TREATMENT PRE 
EFFECT POST 




1.12 
1.37 


0.69 
0.52 




0.94 
1.25 


0.66 
0.71 




1.27 
1.06 


1.02 
0.45 




1.09 
0.78 


0.68 
0.47 






PRE 
POST 




1.46 
0.93 


0.30 
0.55 
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TABLE D-9- 

Transfer Test (Content Scale) 
Study I Descriptive Statistics 



ECOLOGY 
TEACHER 


PROBING AND 
REDIRECTION 
TREATMENT 


NO PROBING AND 

REDIRECTIOfJ 

TREATMENT 


FILLER 

ACTIVITY 

TREATMEfIT 


ART 

ACTIVITY 
TREATMffIT I 




WRIHEN 

EXERCISE 

TEACHER 


WRITTEN 

EXERCISE 

TREATHENT 






aAss 

N 


1 

J 


SD 


CLASS 

^ 




SD 


UASb 

N 


I 


SD 


LLASb 

N 


ii 


SD 




ID 




1 flvv 

N 


J 




] 

DELAY 


10 


5.75 


3.19 


1 


12.08 


3.17 


9 


6.50 


5.02 


2 


8.83 


2.93 




13 


DELAY 


ijo 


NO 


DATA 


I 

DELAY 


6 


7.60 


2.97 


5 


7.50 


3.18 


11 


8.13 


3.28 


12 


9.17 


6.05 




13 


DELAY 


2 3 


8.83 


3.62 


3 

DELAY 


1 


12.50 


6.59 


10 


7.33 


5.13 


2 


9.67 


4.17 


9 


6.25 


3.95 


< 


13 


DELAY 


9 5 


5.90 


4.98 


ii 

' DELAY 


3 


6.75 


3.27 


7 


7.92 


4.89 


8 


5.58 


3.44 


4 


3.90 


3.58 




13 


DELAY 


10 7 


4.43 


2.56 


5 

DELAY. 


5 


5.83 


3.95 


11 


11.75 


3.17 


12 


3.80 


3.19 


6 


NO 


DATA 




14 


DELAY 


5 4 


8.75 


4 MA 

4.44 


6 

DELAY 


7 


8.58 


4.34 


3 


6.60 


3.31 


4 


5.13 


3.66 


8 


5.50 


1.84 




15 


DELAY 


3 5 


7.10 


2.10 


^ DELAY 


8 


9.42 


4.27 


4 


6.30 


4.66 


3 


7.33 


5.12 


7 


5.17 


2.23 




15 


DELAY 


4 5 


6.50 


4.21 


^ DELAY 


12 


6.20 


2.84 


6 


6.75 


3.14 


5 


8.C3 


5.67 


n 


5.43 


3.94 




15 


DELAY 


7 10 


5.95 


3.48 


' DELAY 


9 


8.75 


4.52 


2 


9.20 


0.27 


1 


9.50 


3.10 


10 


5.33 


2.73 




15 


DELAY 


9 8 


6.94 


2.21 


DELAY 


4 


7.30 


2.49 


8 


8.40 


2.63 


7 


4.92 


3.22 


3 


2.88 




1.65 














DELAY 


11 


10.42 


3.72 


12 


5.33 


3.20 


6 


7.33 


1.97 


5 


5.08 


2.75 














DELAY 


2 


11.60 


1.85 


9 


9.83 


2.62 


10 


6.00 


2.92 


1 


11.92 


'^.83 














TREATNEHTnciAY 
EFFECT ™ 




8.39 


2.24 




8.25 


2.11 




6.82 


183 




6.31 


2.62 






DELAY 




6.80 


1.48 



m 

300 

o 

ERIC 



TABLE D-10 



Transfer Test (Logical Extension Scale) 
Study I Descriptive Statistics 



ECOLOGY 
TEACHER 


PROBING AND 
REDIRECTION 
TREATHENT 


__t , 

HO PROBING AND 

REDIRECTION 

TREATMENT 


FILLER 

ACTIVITY 

TREATHENT 


[ 

ART 

ACTIVITY 
TREATMENT!' 




WRITT 
EKERC 
TEACH 


EN 

ISE 

ER 


yRIl 
EXEf 

im 


TEN 

!C!SE 

ITHENT 




ID 


M 

5 


J 


SD 


CLASS 
N 


J 


SD 


CLASS 

N 


t 


SD 


:lass 

N 


J 


SD 




ID 




CLAbS 

N 


I 


SD 


DELAY 


10 6 


0.17 


0,41 


1 6 


3,00 


1.87 


9 6 


1.57 


2.01 


2 6 


1.92 


1.77 




13 


DELAY 


1 


NO 


DATA 


DELAY 


6 5 


1.00 


0,79 


5 6 


2.08 


2.11 


11 4 


1.75 


1.94 


12 6 


1.83 


1.47 




13 


DELAY 


2 3 


2.50 


2.60 


3 

DELAY 


1 6 


3.33 


3.40 


10 6 


0.75 


1.41 


2 6 


2.00 


2.35 


9 4 


1.50 


2.35 




13 


DELAY 


9 5 


0.80 


0.57 


4 

DELAY 


3 6 


1.25 


1.94 


7 6 


1.08 


1.43 


8 6 


1.08 


1.24 


4 5 


0.00 


0.00 




13 


DELAY 


10 7 


0.07 


0,19 


5 

DELAY 

1 


5 6 


1.50 


1.67 


11 6 


2.25 


2,04 


12 5 


0.90 


1.08 


6 


NO 


DATA 




14 


DELAY 


5 2 


3.13 


3.15 


DELAY 


/ 6 


1.42 


1.16 


3 5 


2.50 


1.54 


4 4 


0.13 


0.25 


8 5 


0.60 


0.08 




15 


DELAY 


3 5 


1.50 


1.73 


7 

DELAY 


8 6 


2.33 


3.15 


4 5 


0.80 


1.30 


3 6 


1.75 


1.89 


7 6 


0.42 


0.65 




15 


DELAY 


4 5 


1.70 


3.53 


8 

DELAY 


12 5 


0,70 


0,57 


6 6 


1.42 


1.56 


5 4 


2.13 


2.02 


11 7 


0.79 


1.07 




15 


DELAY 


7 10 


1.00 


1.41 


9 [itLnY 


9 5 


1.42 


1,83 


2 5 


1.30 


0.45 


1 5 


2.60 


1.39 


10 6 


0.33 


0.41 




15 


DELAY 


8 8 


0.69 


'0.59 


10 DELAY 




n an 


0 65 


8 5 


0.60 


0.82 


7 6 


0.17 


0,26 


3 4 


0,00 


0.00 














n DELAY 


11 5 


2.08 


1.69 


12 6 


0.92 


1.39 


6 6 


1.67 


2,96 


5 6 


0.67 


0.82 














12 DELAY 


2 5 


2.60 


1.79 


9 6 


1.92 


1.39 


10 6 


0.92 


1.50 


1 6 


2.50 


1.73 














TREATHENT 
EFFECT DELAY 




1.56 


0,88 




1.55 


0.78 




1.39 


0.77 




0.96 


0.84 






DELAY 




1.42 


1.01 



TABLE D-11 

Question-Generatinq Test, Paper-and-Pencil Measure (Number of Nonpertinent Questions) 

Study I Descriptive Statistics 



1 ECOLOGy 
' TEACHER 

' ID 


PROBING AND 
REDIRECTION ^ 
TREATMENT 

CLASS T': 
fl X ' SD 


flO PROBING AND 
, REDIRECTION , 
' TREATMENT 

I SD 


FILLER 

ACTIVITY 

TREATMENT 

N X ■ SD 


ART 

ACTIVITY 
TREATMENT I 


•rrr; : 


WRITTEN 

EXERCISE 

TEAC'riER 

I 

ID 1 

t 


yRITTEfj 

EXERCir^E 

TREATMEr 

CLASS . 
N ^ 


SD 


M PRE 
1 POST 


6: .00 
^° 6l .00 


.00 
.00 


1 5 .50 .50 
5 .50 ' .87 


q 6, .33 . .41 
^ 6:1.67 2.09 


, 6| .17: .41 
• 61 .17 .26 




13 

:P0ST 




.33 
.00 


.00 
.M. 


' 2 PRE 
POST 


6i .58 
^ 6! .13 


,59 
.13 


r 5 .11 ; .16 
^ 6 .58 ! .97 


" 5' .60 .89 


7' 4.64; 4.75 
'2 7i 1.50; 1.12 




13 

POST 


^ 3 


.00 
1.00 


00 
1.00 


3 PRE 
POST 


, 6. .67 

^ 6' .75 


.98 
.82 


,« b .11 1 .1/ 
6 .33 i .41 


^ 6 .33 .41 


„ 6 6.42! ?.66 
5 6' 3.08' 5.15 




10 


PRE 
POST 




2.20 
1.80 


2.84 
1.57 


4 PRE 
POST 


, 5 .10 
^ 6! .33 


.n 

.41 


c on 07 

' 6' .17 : .26 


6' .25 .42 


. 4 5.13 1.59 
4! .00 .00 




13 


PRE 
POST 




.81 


1 07 
.19 


5 PRE 

POST 


, 5 .31 .42 
^ 6! .12 .20 


t' \t\ ' lit 

^1 6' .17 .26 


4; .IJ .^D 

'2 5' .10 .22 


6 : NO 


DATA 




14 


PRE 
POST 


, 4 : .88 

M 1 .50 


.85 
.71 


6 PRE 
■ POST 


, 6^ .25 1 .61 
' 6 ,67 .82 


- 6 .33 1 .41 
^ 5' .60 ' .11 


. 6 .33 ! .61 
^ 4 .13 .25 


5, 1.00 
2 5 .30 


1.70 
.27 




15 

, 


PRE 
POST 




.08 
.33 


.20 
.51 


7 PRE 
POST 


, 6 .00 ' .00 
^ 5 ,17 :.41 


, 4 .U ' .25 
^ 6 .17 i .26 


, 6, .33 1 ,82 
^ 6 .17 1 .41 




.20 

.40 


.27 
.65 




15 


PRE 
POST 




.00 

1.20 


.00 
2.17 


Li_! CO 
CO 


19 5 .11 .17 
6 .00 .00 


r 61.83 12.88 
° 6 .83 ' .98 


, 5' .10 ' .22 
^ 5 .10 ■ .25 


„ 6 2.33 4.17 
" 7: .93 1.17 




15 


PRE 
POST 




1.00 

,10 


2.65 
.32 


9 PRE 
POST 


Q 6 .35 .71 
^ 6' .12 .18 


J 6 .25 - .42 
^ 6 .33 .61 


, 5'. 10 .22 
' 6,. 08 .20 


I, 5 5.96 .82 
5 1.60{ 3.58 




15 


PRE 
POST 


fi 6 .33 
^ 7 .07 


.61 
.19 


10 PRE 
POST 


^ 6 .08 


.00 
.20 


6 .00 .00 
° 6 .00 .00 


, 5 1.80 : 2.75 
' 5 .50 .87 


, 6' 5.50, .99 
^ 5' .80: .57 








i 




11 PRE 
POST 


6 .50 
" 5 .30 


.63 
.45 




1.75 1.37 
.67 1.08 


^ 6 


2.40 
.83 


5.10 
1.81 




1.75 
.92 


2.38 
1.11 














12 PRE 
POST 




M 
.25 


.41 

j42 

1.22 
0.48 




1.00 
1.90 

0.71 
0.52 


l.$2 
1.78 . 

0.63 
0.50 


10 6 


.25 
.00 

0.60 
0.40 


M 

.00 




.30 
.60 


.57 
.89 














ITREATMENT PRE 
EFFECT POST 




0.84 
0.52 


0.75 
0.47 




1.90 
0.94 


2.00 
0.88 






PRE 
POST 




0,63 
0,56 


0.70 
0.63 



394 

303 ■ K 

er!c 



TABLE 0-12 



Question-Generating Test, Paper-and-Pencil Measure (Nyoiber of Pertinent Questions) 

Study I Descriptive Statistics 



ECOLOGY 
TEACHER 


PROBING Al^ 
REDIRECTK 
TREATMENT 


D 
N 

SD 


NO PROSING AND 

HEDIRECTION 

TREATMENT 


FILLER 

ACTIVITY 

TREATMENT 


ART 

ACTIVITY 
TREATMENT I 




WRITT 
ElERC 
TEACH 

ID 


EN 

ISE 

ER 


WRI 
EIE 
TREi 

IAS- 
N 


TTEN 

RCISE 

^TMENT 

I SD 




CDCS ; - 

Ni ^ 




)( 


SD 


TO' 

N 


I 


SD 


^\ I 1 SD 




~1 " " PRE 
POST 


'» I 


15.0C 
lO.OC 


6.60 
3.05 


' I 


11.50 
12.60 


J • uo 

7.72 


g 

^ 6 


13 92 
10.58 


3 07 

V • wf 

3.10 


„ 6 
2 6 


15.00! 7.01 
14.171 5.87 




13 


PRE 
POST 


1 3 
3 


15.67! 8.33 
20.00 1 10.44 


2 PRE 
POST 


, 6; 17.0£ 
^ fii 10.92 


5.50 
4.39 


-1 


15.40 
8.33 


7 83 
3.66 


5 

" s 


9 00 

J • WW 

13.00 


1.87 
8.06 


,0 7 
12 1 


12.36| 13.90 
14.64; 13.49 




13 


PRE 
POST 




15.00 
15.17 


Z.8J 
6.05 


3 PRE 
POST 


, 61 20.2 4.48 
' 6^ 20..0 7.27 


1« 

D 


12.00 
11.33 


2 98 
5.98 


„ 5 


12.50 
12.58 


4.70 
6.76 


« 6 
9 6 


13.17i 13.48 
9.83! 5.89 




13 


PRE 
POST 




15. ZO lAi 
12.00! 5.04 


4 PRE 
POST 


, 5 14.90 8.92 
^ 61 9.0(1 8.43 


7 5' 16.60 
' 6l 11.83 


7 41 
6.09 


' 6 
«■ 6 


12.75 
11.83 


4 78 
6.20 




10.10' 7.36 
3.00; 1.83 




13 


PRE 
POST 




15.31 5.50 
[12.43, 5.30 


5 PRE 
POST 


c 6, 12.92 8.46 
^ 6i 13.33 7.59 




12.30 
13.30 


6.98 
5.37 




8.38 
5.90 


2.06 
3.54 


6 


NO i DATA 




14 


PRE 
POST 


' 4 


15.62' 5.79 
14.50 4.76 


6 PRE 
POST 


, 6' 13.58 2.90 
' 6 12.9^ 4.03 




15.83 
12.30 


8.53 
6.1C 


4^ 
^ 4 


10.1/ 
4.75 


8.28 
4.65 


« I 


8.70l 3.21 
7.70: 4.15 




15 


PRE 
POST 




11.25 2.56 
10.17 3.67 


7 PRE 
POST 


J, 6: 11.92 4.32 
^ 6 18.9^ 6.07 




13.50 
6.42 


7.90 
6.44' 


3 ^ 
^ 6 


14.42 
10.00 


9.89 
7.95 




14.70 2.17 
11.80^ 2.39 




15 


PRE 
POST 




14.75 4.99 
7.20 4.78 


8 PRE 
POST 


1, 5 1.10 1.75 
6: 8.17 3.25 


^ 6 


15.42 
11.17 


5.90 
4.12 




15.10 
14.40 


4.56 
6.23 




5.67^ 3.34 
9.36! 4.66 




15 


PRE 


' 10 10.95 5.69 


9 PRE 
POST 


Q 6 14.6710.25 
^ 6^ 12.83 4.49 


2 ^ 
^ 6 


18.00 
17.33 


2.90 
7.61 




18.10 
19.75 


7.68 
8.54 


,0 ^ 


12.20 
9.20 


4.56 
5.59 




15 


PRE 
POST 


n 6 17.58 5.85 
7 :i6.57j 4.50 


10 PRE 
POST 


, 6' 10.00 4.00 
^ 6 7.17: 1.84 


8 ? 

0 


15.08 
15.67 


9.12 
5.42 




10.80 
11.00 


4.62 
6.94 




11.70 
7.00 


6.52 
6.82 








i ; 



11 PRE 
POST 




11.33 
10.2C 


6.51 
5.93 


12 ^ 
6 


11.75 
7.67 


4.33 
2.14 




19.10 
14.75 


6.04 
7.59 




13.83 
11.92 


IM 
5.60 














12 PRE 
POST 




]6.l7 
19,25 


5.78 
5.27 


9 ^ 
^ 5 


20.42 
12.70 


6.23 
6.21 




13.42 
JO.- 67 

13.14 
11.68 


4.80 
21i 




15.30 
14.30 


1.89 
9.04 












TREATMENT PRE 
EFFECT POST 




14.08 
12,72 


2.89 
4.44 




14.82 
11.72 


2.73 
3.14 




3.32 
3.82 




12.07 
10.26 


2.94 
3.58 






PRE 
POST 




14.92 
13.33 


1.70 
3.88 



PO 
PO 



TABLE D-13 

Question-Generating Test, Paper-and-Pencil Measure (Number of Specific Questions} 

Study I Descriptive Statistics 



TEACHER 


PROBING AND 
REDIRECTION 
TREATHENT 


NO PROBING AND 

REDIRECTION 

TREATMENT 


FILLER 

ACTIVITY 

TREATMENT 


ART 

ACTIVITY 
TREATMENT I 




WRITTEN 

ElERCISE 

TEACHER 


WRITTEN 

EXERCISE 

TREATMENT 


SD 


cass 

N 


t 


SD 


aASSi 


)( 


SD 


CLASS 

N 


)( 


SD 


CLASS 

N 


J 


SD 




ID 




lASS •■■ 

N^ )( 


1 PRE 
POST 


10 I 

C 


6.25 


4.54 
3.99 


ri 


^ 3.00 
^ 1.40 


2.37 
0,82 


6 


2.58 
1.52 


1.93 
1.39 


' I 

D 


2.75 


2.14 

L.l\ 




13 


PRE 
POST 


] 3 '2.50 1.50 
' 3 4.83 0.76 


2 PRE 
POST 




4.92 


3.99 

Tt JO 


5 


5.80" 
L fi7 


3.17 

L.OD 




3.90 

D.UU 


1.98 




3.00 

1 9Q 
1 *u 


3.11 

i »u 




13 


PRE • 
POST 


« 2,0.00 
^ 3 3.00 


0.00 
12.78 


3 PRE 
POST 


V 


4.67 
H fi7 




'» 6 

D 


3.33 


2.40 

L. t d 


^ 6 


2.50 
3.50 


2.15 


0 


1.33 

1 . JU 


1.54 

9 W 




13 

'■^ 'post 


Q 5^7.50 4.84 
^ 5 ' 5,20 1 3.32 


4 PRE 
POST 


3 ^ 

u 


3.40 

1 «uJ 


2.07 
1 fi7 




2,80 


1.75 

L.OO 


^ 6 


1.58 
2.58 


1.69 




3.70 
1 nn 


2.82 

1 99 




:PRE 

'post 


,„ 8 4.75 3.45 
7 4.07 5.56 


5 PRE 
POST 


5 S 


1.92 
3.00 


1.69 
3.12 


" I 


3.90 
4.58 


0.96 
2.82 




1.25 
0.90 


1.19 
0.89 


6 


JO 


DATA 




14 '^^^ 
, POST 


r 4 4.88 3.06 
^ 4 4.25 3.75 


6 PRE 
POST 


^ 5 


4.67 
3.50 


1.54 
2.47 


' 5 


5.92 
2.70 


3.76 
2.52 




3.67 
0.75 


4.45 
1.50 


n 5 

« 5 


2.10 
1.00 


1.82 
1.00 




15 'P^^ 
POST 


, 6 i 4.67 2.52 
^ 6 i 2.33 2.88 


7 PRE 
POST 


" 6 


2.00 
4.25 


1.41 
3.66 


' 6 


5.62 

2.57 


3.64 
4.24 




7.50 
3.17 


5.06 
4.34 


7 5 

/ r 


5.40 
2.50 


3.42 
1.17 




.POST 


. 4 1 5.12 1.60 
^ 5 '3.10 2.48 


8 PRE 

DncT 
rUbl 




2.80 
1.58 


UO 
0.97 


' i 


Ul 
1.08 


1.43 
1.74 




4.30 
4.80 


4.47 
2.31 




'3.00 
1.64 


1.98 
1.M 




K 'PRE 

'post 


, 7 2.79 1.15 
' 10 1.70 2.80 


9 m 

POST 




■2.75' 
5,08 


3.37 
2.54 


2 ^ 


1.67 
3.08 


1.72 
3.01 




5.20' 
4.92 


3.25 
3.83 




5.70 
3.10 


4.)6 
3.81 




15 '^^^ 
|POST 


g 6 2.75 2.07 
7 6.36 , 5.45 


10 PRE 
POST 




4,^)3 
1.92 


2.42 
1.20 


' 6 


4.67 
5.75- 


5.08 
3.06 




2.80 
2.10 


2.59 
2.31) 


-I 


3.80 
2,40 


3.29 

4,05 








11 PRE 
POST 




2.50 
2./0 


1.95 
2.64 




1.50 
0.75 


2.28 
0.76 


, 5i 3.20 
° 6:3.58 


3.49 
5.01 




2.50 
3.75 


2.41 
2.88 












12 PRE 
POST 




1.42 
4.33 


1.56 
8.26 




5.42 
4.20 


3.41 
4.48 




3.50 
2.67 


2.70 
1.37 




3.00 
2.60 


3.92 
2.22 














TREATHENT PRE 
EFFECT POST 




3.51 
3.30 


1.51 
1.36 




3.84 
2.96 


1.62 
1.56 




3.50 
3.05 


1.68 
1.63 




3.30 
2.11 


1.31 
0.89 






PRE 
POST 




3.88 
3.87 


2.13 
1.46 



30^' 308 . 

00 

o 

ERIC 



TABLE D-14 

Question-Generating Test, Paper-and-Pencil Measure (Number of Requests for Rationale) 

Study I Descriptive Statistics 



ECOLOGy 
TEACHER 


PROBING AND 
REDIRECTIOfl 
TREATMENT 


NO PROBING AND 
REDIRECTIOfr ■ 
TREATMEIff 


FILLER 

ACTIVITy 

TREATMENT 


ART 

ACTIVITY 
TREATMENT I 




WRITTEN 

EXERCISE 

TEACHER 


WRITTEN 
EXERCISE ■ 
TREATMENT 


N 


)( 


SD 


N 




SO 


N 


I 


SD 


LLAss 

N 


I 


SD 




ID 




N 


J 


SD 


1 PRC 

POST 




'ITT 

1.00 


TIT 

2.45 


c 


1.60 


2.30 


' I 


n fin 

U. jU 

0.42 


0.49 


r 

2 I 


TW 

1 .uo 

0,83 


"TIT 
1.17 




■13 


POST 




1,50 


2.18 


2 PRE 
POST 


« I 


U. 1 / 

0.25 


U.'f 1 

0.42 


^ 6 


1 .uu 
0.42 


1 7"? 
1 ,/0 

0.49 




u.uu 
1.20 


UiUU 

1.79 


1 

12 7 


UiUU 

0.00 


U.UU 

0.00 




13 


POST 




1« DU 

1.33 


2.31 


3 PRE 

PO$T 


' I 


4.67 


3.24 




Ui UU 

0.33 


u.uu 

0.52 


r 


1 no 

1 • uu 

0.50 


i./j 
0.55 




n HI 
0,55 


1 .01 

0,80 




13 


POST 


r 


fl fifl 

u. ou 


1 in 

1 . lU 

0.45 


4 PRE 
POST 


^ 6 


n on 
0.42 


A K 

U.4D 
0.80 




U.UU 
0.42 


U.UU 
1.02 




n nn 
U.UU 

0.00 


n nn 
U.UU 

0.00 




n in 
U.oU 

0.00 


n ^7 
U.O/ 

0.00 




13 


rKt 

POST 


Q 


n QQ 
1.00 


1 .UD 

1.56 


5 PRE 
POST 




0.50 
0.50 


1.22 
1.22 




0.00 
0.83 


0.00 
1.33 




0.00 
0.40 


0.00 
0.89 


6 


NO 


DATA 




14 


PRE 
POST 


= } 


1.00 
1.12 


2.00 
1.03 


6 PRE 
POST 




0.00 
0,33 


0.00 
0.82 




0.50 
0.40 


1.22 
0.55 




0.00 
0.25 


0.00 
0.50 




0.00 
0.10 


0.00' 
0.22 




15 


PRE 
POST 




0.00 
0.00 


0.00 
0.00 


1 PRE 
POST 




0.00 
0.00 


0.00 
0.00 




0.00 
0.00 


0.00 
0.00 


3 I 


0.00 
0.00 


0.00 
0.00 




0.00 
0.00 


0.00 
0.00 




15 


PRE 
POST 




0.25 
0.40 


0.50 
0.89 


0 rKt 

POST 




0.00 
0.17 


0.00 
0.41 




0.50 
0.08 


0.63 
0.20 




2". 00 
1.60 


3.08 
1.52 




0.00 
0.43 


0.00 
1.13 




15 


PRE 
POST 




O.U 
0.70 


0.38 
1.27 


9 m. 

POST 




1.33 
1,42 


2.34 
2.20 




0.75 
0.75 


1.40 
0.82 




0.80 
0,3? 


1.30 

0,,52 


10 I 


0.20 


0.45 
1.30 




15 


PRE 

ML 




O.QO 
0.00 


0.00 
0.00 


10 PRE 
POST 




0.00 
0.00 


0.00 
0.00 




0.17 
0.33 


0.41 
0.61 




0.00 
0.10 


0.00 
0.22 


3 5 
' 5 


0.00 
0.00 


0.00 
0.41 














11 PRE 
POST 




0.25 
1.10 


0.61 
1.60 


12 I 


0.17 
0.5. 


0.26 
0.84 


^ 6 


0.00 
0.83 


0.00 
1.33 




0.17 
0.00 


0.41 
0.00 














12 PRE 
POST 




0.50 
1.50 


0.84 
2.81 




1.25 
1.20 


2.82 
2.68 


I 


0.25 
0.50 


0.42 
1.22 




0.50 
0.20 


1.12 
0.45 














TREATMENT PRE 
EFFECT POST 




0.44 
0,78 


0.55 
0.79 




0.54 
0.57 


0.67 
0.46 




0.38 
0.51 


0.62 
0.48 




0.28 
0.27 


0.38 
0.33 






PRE 
POST 




0.49 
0.70 


0.51 
0.57 



6J^ Sid I 

ERIC 



TABLE 3-15 



Question-Generating Test, Paper-ai!d-Peiicil Heaiure (i]yality Rating) 
Study I Descriptive Statistics 



ECOLOGY 

V Via VW 1 

TEACHER 


PROBING AND 
REDIRECTION 
TREATMENT 


NO PROBING AND 

REDIRECTION 

TREATMENT 


FILLER 

ACTIVm 

TREATMENT 


ART 

ACTIVITY 
TREATMENT I 




WRITTEN 

EXERCISE 

TEACHER 


WRITTEN 

EMISE 

TREATMENT 






CDCS 

N 


I 


SD 


N 

1 


I 


SD 


CLASS 

N 


j( 


SD 


N 


)( 


SD 




ID 




:la3s 

N 


I 


SO 


1 PRE 
POST 


10 I 

D 


2.95 


0.47 
U.Do 




3.82 

j. Id 


0.30 
U.Dj 


D 


3.02 


0.42 

\jAi 


D 


0.34 

n in 
UJU 


0.58 




13 


PRE 
DncT 


1 3 

J 


3.00 


0.46 
0.66 


2 PRE 
POST 


D 


3.58 


0.33 

U Jo 




3.12 

0 QQ 


0.35 
U.OU 


3 


3.26 

0. 14 


0.47 

U.ol 




1.34 

t.l4 


1.29 

1 lA 




13 


PRE 

rUjI 


2 2 

. - I 


3.05 


0.50 


3 PRE 

POST 


' I 


3.23 


0.62 

U.Ol 


10 I 


3.08 


0.30 

U.oo 




2.82 


0.62 

11.04 




2.08 


1.16 

1 AQ 
1 ,4o 




13 


PRE 

DflQT 

rUbl 




2.48 


0.69 

0.48 


4 PRE 
POST 


0 


2.72 
L JU 


0.56 

l.4j 




3.20 

Oi 10 


0.50 

n 10 
y./u 


D 


2.53 

L JD 


0.29 

1 10 




2.74 

9 


0.17 
n on 




13 


PRE 


10 J 


2.92 

^ (17 
J.U/ 


0.49 
?.« 


5 PRE 
POST 




2.23 
2.40 


1.22 
1,24 


" I 


3.20 
3.42 


0.56 
0.57 


12 ' 


•2.95 
2.98 


0.30 
0.84 


6 


NO 


DATA 




14 


PRE 
POST 


^1 


3.52 
3.38 


0.29 
0.6? 


6 PRE 
POST 


1 6 
^ 6 


3,32 
3.25 


0.58 
0.61 


' s 


3.23 
3.86 


0.48 
0.95 




2.82 
1.88 


0.94 
1.61 


8 5 


2.40 
2.28 


0.90 
0.79 




15 


PRE 
POST 


' 6 


2.93 
3.45 


0.76 
0.61 


7 PRE 
POST 


^ 6 


2.30 
2.83 


0,36 
0.29 




3.50 
2.47 


0.41 
0.49 


3 ' 


2.65 
2.73 


1.42 
1.58 




3.26 
3.12 


0.57 
0.22 




15 


PRE 
POST 




3.02 
2.48 


0.25 
1,48 


8 PRE 


12 ^ 


2.30 
2,70 


0.94 
0.52 




3.07 
3.12 


0.47 
0.67 




3.22 
2.62 


0.60 
0.74 


n ] 


2.60 
3.07 


1.70 
0.S6 




15 


PRE 
POST 




2.90 
2.90 


0.57 


9 PRE 
POST 




2.32 
3.68 


1,45 
0.43 




3.05 
3,18 


0.42 
0.33 




3.44 
3.07 


0.39 
0.81 




3.32 
2.58 


0.36 
1.44 




15 


PRE 
POST 




2.72 
3.07 


0.61 
0.55 


10 PRE 
POST 




3.08 
2.75 


0.71 
0.83 


8 


2.73 
1,37 


0.39 
0.33 




2.96 
2.62 


0.31 
0.70 


3 ' 
' 5 


2.90 
2.98 


0.52 
1.41 














11 PRE 
POST 


" \ 


3.23 
3.02 


0.55 
0.89 


12 ^ 
6 


3.17 
0.33 


0.47 
0.46 


^ 6 


2.82 
0.12 


0.30 
0.21 




3.02 
2.65 


0.56 
0.36 














12 PRE 
POST 




3.07 
3.12 


0.21 
0.25 


9 ^ 


3.00 
3.38 


0.42 
0.47 




3.07 
3.20 


0.62 
0.34 




2.88 
2.42 


0.24 
1.36 














TREATMENT PRE 
EFFECT POST 




2.85 
3.00 


0.47 
0.42 




3.18 
3.19 


.0.27 
0.33 




2.97 
2.87 


0.27 
0.46 




2.72 
2.67 


0.60 
0.35 






PRE 
POST 




2.95 
3.08 


0.28 
0.30 



312 



mil D-16 

question-Generating Test, Oral Heasure (Number of Nonpertinent Questions) 
jituay I Descriptive Statistics 



ECOLOGY 
TEACHER 



PROBING AND 
REDIRECTION 
TREATMENT 



NO PROBING AND 
REDIRECTION 
TREATMENT 

m 



FILLER 

ACTIVITY 

TREATMENT 




ART 

ACTIVITY 
TREATMENT I 



WRITTEN 

EXERCISE 

TEACHER 



HRIHEN 
EXERCISE 
TREATMENT 



ERIC 



TABLE D-17 



Question-Generating Test, Oral Measure (Number of Pertinent Questions) 
' Study I Descriptive Statistics 



ECOLOGY 
TEACHER 

"If 


PROBING AND 
REDIRECTION 
TREATMENT 


NO PROBING AND 

REDIRECTIOfJ 

TREATMENT 


FILLER 

ACTIVITY 

TREATMENT 


ART 

ACTIVITY 
TREATMENT I 




yRIHEN 

EXERCISE 

TEACHER 


WRITTEN 

EXERCISE 

TREATHEfiT 




HASS 

HI 

11 


I \ SD 




I 


SD 


N 


J 


SD 


CLASS 

N 


)( 


SD 




ID 




N 


I 


SD 


1 PRE- 


10 5 


0.60 

m 


1.08 


1 6 


1.75 
2,67 


1.78 
0,98 


9 \ 
5 


1.58 
1.30 


1.50 
1.35. 


,...5. 


1.00 
J.10_ 


1.73 

111 

J..14 




13 


PRE 
POST , 




2.17 

S.bl 


0.76 
2.0L 




4 


■1 


.50 


5 1 


\i 

U.OU 


8i3 




HI 




12 I 




B 




13 


It 


2 I 


1.1! 


l:f! 


3 PRE 
POST 


0 


1.1/ 

1 f\f\ 

1.00 


1.1? 
1.14 


b 


0.62 

I.OJ 


0.95 

U.4I 


2 \ 

D 


0.33 

1 ^9, 
1 iDO 


0.5S 

1 ,\jL 


U 




0.67 




13 


PRE 

POST 


^\ 


1.40 
1.62 


1 

1 .HO 
1.11 


4 PRE 

POST 


D 


0.00 
1.83 


0.00 
1.84 


' \ 

D 


0.67 

1 49 
\M 


0.75 

1 Afi 
1 M 


e \ 


0.40 
1 nn 


0.S9 

1 .71 


' 1 


1.25 

1 25 


0.96 
1 26 




13 


PRE 
POST 


.] 


0.50 
2.36 


U.QU ^ 

3.52 


5 PRE 
POST 


^ 6 


0.20 
0.67 


0.45" 
1.63 




1.25'' 
2.47 


0.29 
0.58 


-\ 


0.70 
0.67 


0.84 
1.21 


6 


NO 


DATA 




14 


m 

POST 




1.00 


1 .ti 


6 PRE 

POST 




1.25 
2.17 


1.26 
1.33 


' S 


1.62 
1.40 


1.89 
1.56 


' 6 


1.00 
1.17 


1.31! 
1.17 


0 5 


0.00 
0.90 


0.00 
0.74 




1 J 


PRE 

POST 


^ 5 


1.20 
1.00 


1 30 
0.71 


POST 




0.67 
1,05 


0.82 
Ml 




0.50 
1,6? 


0.71 
1,11 


3 « 


0.67 
1.5? 


0.52 
1.50 




0.90 
1.83 


1.02 
1.60 




15 


PRE 
POST 


'1 


0.33 
1.30 


f\ CO 

0.58 
1.20 


8 PRE 

DrtCT 
PUbl 




3.65 
1.62 


4.47 
0.95 




1.20 
2.00 


1.30 
1.58 


^\ 


1.10 
1.83 


1.60 
1,84 




1.30 
1.33 


1.30 
1.03 




15 


PRE 
POST 


7 9 

10 


0.33 
1.10 


0.71 
1.4fi 


9 PRE 
POST. 




1.70 

,2.10 


1.40 
1.02 




0.50 
1.34 


0.50 
1.03 


'1 


1.92 
2.83 


1.02 
1.99 


10 ^ 
1. 


0.60 
2.20 


1.08 
1.60 




15 


PRE 
POST 


^ 7 


0.80 
O.fifi 


0.84 

0.85, 


10 PRE 
pn^T 




0.00 
1.00 


0.00 
1.41 




0.40 
2.50 


0.55 
0.84 


'1 


1.08 
2,00 


0.80 
0.71 


3 6 
fi 


0.83 

ilia. 


2.04 
O.flO 














11 PRE 
POST 


' I 


1.20 
1,25 


1.79 
1,26 




6.87 
1.40 


5.51 
0.36 


^ 6 


1.08 
2.08 


1.02 
1.77 


5 

^ 5 


0.90 

1.40 


1.02 
1,14 














12 PRE 
. . , PO$T 


1 5 
6 


2.10 
1.42 


1.82 
1.24 




1.00 
2,40 


1.67 
1.56 


10 I 
5 


0.70 
UO 


0.98 
1,30 




1.00 
0.80 


1.06 
0.84 














TREATMENT PRE 
EFFECT POST 




1.17 
1.36 


1.00 
0.49 




1.49 
1.82 


1.76 
0.64 




0.96 
1.63 


0.46 
0.61 




0.94 
1.31 


0.38 
0.59 






PRE 
POST 




0.97 
1.65 


0.58 
0.94 
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TABLE D-18 



question-Generating Test, Oral Measure (Quality Rating) 
Study I Descriptive Statistics 



ECOLOGf 
TEACHER 


PROBING AND 
REDIRECTION 
TREATMENT 


NO PROBING AND 

REDIRECTION 

TREATMENT 


FILLER 

ACTIVITY 

TREATMENT 


ART 

ACTIVITY 
TREATMENT I 




WRIHEN. 
EXERCISE 
TEACHER 


WRITTEN 

EXERCISE 

TREATMENT 




Td" " " 


N 


I 


SO 


CLASS 

N 




SD 


CLA S 

N 


I 


SD 


CLASS 

N 


I 


SD 




ID 




lASS 

N 




SD 


1 PRE 
POST 




U. j4 

0.33 


n CO 

0.58 




1. lb 

lr25 


ft cn 

0.21 




U.^b 
1.08 


0.95 


C 


n fin 

U.OU 

0.74 


n Q9 
0.70 




13 


POST 


1 ^ 
' 3 


1 17 
1.1/ 

1.13 


0.29 
0.15 


2 PRE 

POST 


r 


ft ftC 

0.95 
0.90 


ft on 

0.89 
1.04 


0 

5 2 
5 


1 CA 

LbU 
0.50 


0.71 




1 JU 

1.28 


U./D 

0.36 


12 ^ 
3 


n fid 
1,33 


n fio 
1,16 




13 


rr\U 

POST 


^ 3 


0.67 


0.85 
0.58 


3 PRE 
POST 




ft TO 

0./3 


ft £7 

0.5/ 

m 


10 \ 
_ B 


U.bb 

1.13 


n on 
U.oU 

0.10 


2 ^ 
6 


U7 


U.JO 

0.43 


C 


n fin 

U.OU 

1,40 


n 

1.34 




13 


POST 




fl 7fi 
1.10 


0.65 
0.76 


4 PRE 
POST 


r 


ft Ar\ 

0.00 
0.75 


ft Aft 

0.00 
0.61 




0./3 

0.77 


ft oyi 

0.70 


8 \ 


ft 

0-58 


U./D 

0.68 


' 1 


1 in 
l.iu 

lt50 


n Qn 

U.OU 

1.22 




13 


PDP 
rf\L 

POST 


7 


U< JO 

0,96 


0.48 
0,68 


5 PRE 
POST 




0.26 
0,22 


0.58 
0.53 




1.12 
1.33 


0.25 
0,58 




0.60 
0.48 


0.55 
0.75 


6 


NO 


DATA 




14 


PRE 
POST 


5 ^ 


0.50 


0.71 


6 PRE 
POST 




1.20 
1,03 


0.85 
0,54 




0.55 
0.66 


0.64 
0,62 




0.63 
0.80 


0.51 
0.65 




0.00 
1.00 


0.00 
0.71 




15 


PRE 
POST 


3 ' 


0.86 
0.90 


0.86 
0.55 


1 PRE 
POST 




0.58 
0.92 


0.80 
0,80 




1.00 
0,9? 


1.41 
0.63 




0.67 
0.97 


0.61 
0.81 




0.70 
0.87 


0.84 
0.72 




15 


PRE 

POST 


' 5 


0.23 
1.06 


0.40 
0.77 


Q nnp 

0 PRE 
POST 




0.62 
1.32 


0.48 
0.46 




0.92 
0.94 


0.90 
0.56 




0.50 
0.78 


0.71 
0.61 




0.82 
1.38 


0.76 
0.78 




15 


PRE 
POST 




0.28 
0.74 


0.56 
0.81 


9 PRE 
POST 




0.98 
1,06 


0.70 
0.34 




0.90 
1.30 


0.89 
0.87 




1.05 
1.02 


0.56 
0.30 




0.90 
1.18 


0.89 
0.70 




15 


PRE 
POST 




1.14 

1.01^ 


1.05 
0.78 


10 PRE 
POST 




0.00 
0.65 


0.00 
0.76 


^ 6 


0.50 
1.22 


0.71 
0.23 




0.92 
1.28 


0.66 
0.53 


3 ' 
' 6 


0.20 
0.42 


0.49 
0.49 














11 PRE 
POST 




0.64 

1,92, 


0.92 
0.79 


12 \ 
b 


5.37 
1.10 


8.34 
0.74 


^ 6 


0.75 
1.05 


0.76 
0.65 


' 5 


0.70 
1.06 


0.84 
0.72 














12 PRE 
POST 


1 5 
6 


1.12 
0.93 


0.76 
0.75 




0.45 
0.92 


0.70 
0.54 


10 ^ 
b 


0.30 
0.70 


0.45 
0.67 




0.70 
0.84 


0.67 
0.85 














REATMENT 
FFECT POST 




0.62 
0.80 


0.41 
0.31 




1.23 
1.00 


1.34 
0.27 




0.69 
0.95 


0.31 
0.29 




0.63 
1.07 


0.30 
0.33 






PRE 
POST 




0.66 
0.95 


0.35 
0.17 



TABLE 0-19 



Word Association Scale (Attitude toward Balance of Nature) 
Study I Descriptive Statistics 



ECOLOGY 
TEACHER 


PROBING AND 
REDIRECTION 
TREATMENT 


NO PROBING AND 

REDIRECTION 

TREATMENT 

lis "- 

fl I SD 


F 

A 
T 

tlASS' 
N 


ILLER 

CTIVITY 

REATMENT 


ART 

ACTIVITY 
TREATMENT I 




WRITTEN 
TEACHER 
ID| 


WRITTEN 

TREATMENT 
IA5S 1 _ 

SD 


10 


CCASS 

N 


, if 


SD 


I ' SD 


n! ^ : SD 




1 FKt 
POST 




55.85 

58.33 


" 9.S6' 
1^ 67 


1 6 56.50 . 5.24 
5 59.40 ' 7.23 




51.67 
58.17 


3,78 
8.70 


, 5 '55.67: 4:59 
^ 6 i 50.17! 7.41 




13 'P^^ 
|POST 


1 3!56.00 10.58 
' 3 60.00 , 4.58 


I PRE 
POST 


^ \ 


52.33 
1 57.60 


3.56 

u • ju 


r 6,52.67 : 5.57 
6 57.67 1 8.91 




61.50 7.42 
53.60 9,79 


„ 7 1 46.86] 15.44 
6160.00! 11.19 




1, iPRE 
jPOST 


« 3,49.33 9.02 


3 FKh 
POST 


T 6i62.17 
' 6'49.17 


3.19 

6 "il 


in 6 49.00 
6 56.50 


15.07 
15.72 


P 5' 53.40 6.80 
^ 6 53.67 20.74 


Q 6 47.17 i 19.03 
^ 6 52.OOI 13.27 




1. !PRE 
iPOST 


P 5,51.80 10.43 
^ 5j49.40 1 6.39 


4 PRE 
POST 


. 6 53.50 
6! 52,50 


10.78 
1? ^1 


7 6 54.50 5.39 
6,59.50 7.40 


P 5; 46.80 8.70 
^ 4 57.75 6.50 


. 5.56.40' 7.89 
^ 4 1 34.25 19.53 




1, tPRE 
'POST 


in 8'47.00' 10.93 
6:48.33 ^1.62 


5 PRE 
POST 


r 6 50.00 
^ 5I56.2O 


11.03 
10.18 


n 6,54.67 5.57 
" 6151,17 '13.32 


6:53.17;15.97 
5! 54.80, 9.23 


6 


NO jOATA 




14 jPR^ 
'POST 


r IM.hl 7.09 
2156.00 2.83 


5 PRE 
POST 


7 5!56.80 
' 5 54.80 


10.94 
9.15 


1 6155.33 
3 62.67 


3.20 
11.02 


. 5 59.00|ll.36 
^ 4 '57.50 15.00 


« \ 


49.80 1 17.21 
65.50: 6.36 




15 i^R^ 
ipOST 


. 6:59.67 10.46 
^ 6:58.50 13.31 


T nnr 

/ PRE 
POST 


n 6:53.67 
° 4 54.00 


7.31 
7.62 


. 5 50.60 11.48 
5 62.20 1 6.26 


, 6,55.33|11.91 
^ 6! 54.50119.15 


7 4^4.75' 3.86 
' 6 60.83 '10.07 




15 'P^^ 
IPOST 




48.75 9.81 
50.20.20.89 


8 PRE 

rUol 


5 56.50 
' 5 56.00 


3.08 
8,06 


. 4:55.75 1 4.79 
° 5 43.40 ' 9.74 


r 5i53.00i7.31 
^ 5 59.00 10,46 


M 6 54.17 5.23 
" 61 52.83 15.12 




15 'P^^ 
" POST 


7 10 
' 9 


56.20 ' 4.54 
56.22 7.03 


9 PRE 
POST 


Q 6 49.17 
^ 6'61.17- 


6.34 
11.80 


« 6 54.00' 5.44 
^ 6 56.83 ' 8.75 


, 6;60.33i9.11 
' 6| 59.83: 7.99 


in 4:60.00 
5163.80 


.11.80 
6.94 




15 


PRE 
POST 


g 7 50,14 7.54 
7 53.00 5.94 


.10 PRE 
POST 


. 6' 57.83 
^ 6'54.17 


8.75 
10.92 


6 55.33. 8.36 
^ 6 62,00 . 6.51 


, 6 53.83 1 3.76 
' 5 65.40. 6.62 


, 4! 45.50 
^ 6 '53.00 


3.11 
10.55 






1 




11 PRE 
POST 


6150.17 
" 6;55.00 


6.55 
14.67 


5 54.80 18.89 
6:57.00,17.49 


6 53.33 8.33 
" 6 56'.33in.64 


, 5 46.00 
^ 6 58.17 


7:24 
8.93 










12 PRE 
POST 


^ 6 


54.50 
58.50 


3.51 
6.38 


9 ^ 
^ 4 


59.83 
63.00 


8,91 
10.10 




52.33 1 7.56 
62.17,10.61 




52.17 
56.67 


11.27 
12.39 










r 




TREATMENT PRE 
EFFECT POST 




54.37 
55.62 


3.75 
3.13 




54.41 
57.61 


2.77 
5.62 




54.47 4.08 
57.72 3.561 




52.59 
55.74 


6.27 
8.38 






PRE 
POST 




51.84 
54.35 


4.43 
4.26 
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TABLE D-20 



Word AssociatTon Scale (Attitude toward Ecology) 
Study I Descriptive Statistics 





PROBING M 
REDIRECTIC 
. TREATMENT 


ID 
)N 

so 


NO PROBING AND 

REDIRECTION 

TREATMENT 


FILLER 

ACTIVITY 

TREATMENT 


ART 

ACTIVITY 
TREATMENT I 




WRITTEN 

EXERCISE 

TEACHER 


WRITTEN 

EXERCISE 

TREATMENT 




CDBS 

N 


X 




■CLASS _ 1 ^„ 
NX : SD 


f|l X i SD 




Tn 




:LA5S 

N 


X 


SD 


'RE 
'OST 


10 I 


15:83 


M 


1 I mi 




m iJ:l) 


„ 6 1 54.O0!ll.l0 
^ 6 [61.17! 8.68 




13 


PRE 
POST 


' I 


34.00 
39,33 


21.38 


w — 

Uo i 




54.67 
60.40 


9.42 
7.99 


5 ^ 
^ 6 


58.50 
53.33 


11.41 
23.22 


n 6 1 54.33' 18.53 
' 5 ' 55.20 10.47 


,P 7 1 51.57 il9.45 
6 166.67 1 6.80 




13 


PRE 
POST 




59.00 
67.00 


4.24 


'OST 


, 6; 64.50 
' 6' 52.33 


5.9S 
8.82 


10 6 
6 


41.83 
50.33 


13.35 
14.95 


„ 5 : 50.60, 5.73 
6 62.67 10.60 


Q 6 42.33 il5. 31 
^ 6 1 54.83 !l4.74 




13 


PRE 
POST 




51.80 
69.60 


20.38 

n.R9 


'RE 
'OST 


- 6 52.50 
^ 6! 56.00 


10.56 
11.14 


, 6 56.00 
' 6 65.33 


12.03 
5.54 


(, 5^50.00 8.09 
" 4 163.75 5.80 


' ,4 


43.40 12.86 
61.25 7.63 




13 


PRE 
POST 


in 8 39.13 

fi :f;7.8.1 


15.00 
14.09 


'RE 
'OST 


, 6 46.83i ;.3l 
^ 5l 49.40| 22.47 


n 6 51.83, 18.63 
" 61 61.83; 12.78 


6:55.17; 8.98 
5-60.60' 9.29 


6 


NO IDATA 




14 


PRE 
POST 


r 6 150.33 : 17.67 
? |fiR Rfl : ? 1? 


'RE — 
'OST 


7 51 56.80! 7.98 
' 5 58.00! 12. 9d 


, 6 ; 53.67 
^ 3 ' 66.33 


3.88 
3.21 


. 5 61.20: 12.24 
^ 4 61.25, 10.31 


8 5 
8 2 


61.80 ' 6.06 
67.00 ; 4.24 




15 


PRE 
POST 


, 6 |62.17 , 6.46 
fi ifi4.nn fi.fifi 


'Rt 
'OST 


- S 58.501 11.20 
^ 4 61.00! 8.76 


. 5 41.60' 12.42 
^ 5 55.40 17.17 


, 6 57.67 
^ 6:55.33 


11.71 
15.74 


7 4 i 56.50 '12.40 
' 6 i 68.67 2.42 




15 


PRE 
POST 




50.75 
S.'^.RO 


15.44 

PS.Ofi 


'RE 
'OST 


6 57. 00' 1.79 
5 59.60' 8.08 


g 4! 58.00 8.04 
5 60.40' 11.84 


r 5 149.40 
5 58.40 


7.77 
1?.01 


n 6:60.00:8.20 




15 


PRE 
POST 




63.20 
6.1,56 


6.30 

7.47 


'RL 
'OST 


- 6 53.67' 15.81 
^ 6 65.33; 11.43 


, 6 53.00 10.97 
6 64.17 7.52 




58.00! 6.32 
63.00 i 7.27 


,„ 4:54.75 ^4.30 
5, 65. 40 i 6. 39 




15 


PRE 
POST 




54.14 
60.71 


10.42 


'Kt 
'OST 


. 6 54.50 
^ 6' 57.33 


7.66 
11.32 


n 6 54.83 11.21 
6 65.33, 5.16 


^ I 


50.33 i 10.17 
66.20: 5.50 


. 4i40.50 5.51 
6 45.33 01. 60 














'RE 
'OST 


6| 59.67 
" 6i 64.67 


8.41 
2.68 


IP 5 64.20 5.85 
6 64.33, 9.77 


6 6 
^ 6 


60.50 
64.33 


8.31 
10,23 


r 6 60.50 ^1.45 
6 61.50 9.25 















'ftE 
>OST 


^ I 


59.17 
58.00 


5.98 
14.70 


' I 


55.50 
65.00 


11.54 
9.35 


10 I 
b 


54.33 
61.67 


11.18 
13,09 


' I 


53.33 
59.67 


14.56 
12.27 














'RE 
'OST 




55.90 
58.41 


4.45 
4.52 




53.55 
61.38 


6.41 
5.40 




54.76 
61.06 


4.08 
3.89 




52.61 
60.84 


7.49 
6.65 






PRE 
POST 




51.61 

60,48 


9.84 
9.iL 



tn 
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TABLE D-21 



Uord Associatioi Scale (Attitude toward Wolves) 
Study I Descriptive Statistics 



• 

ECOLOGt 
TEACHER 


PROBING AND 
REDIRECTION 
TREATMENT 


NO PROBING AND 

REDIRECTION 

TREATHENT 

CLiissr- 7" 

f| i SD 


F 
A 
T 

ttlsf 

III 


ILLER 

cTivny 

REATMEKT 


ART 

ACTIVITY 
TREATHENT I 




r 

WRITTEN 
EXERCISE 
TEACHER 


WRITTEN 

EXERCISE 

TREATMENT 


ID 


CLASS ; - i 
N X ! SD 


I • SD 


CLASS 1 - ■ ;■■ 

n! X ; SD 


ID 




:lass 

N 


X SO 


POST 


in 6i 42.1/ 
6: 56.33 


6.43 
10.88 


' I 


43.17 
55.00 


11.72 
6.56 


9 « 

6 


46.50; 9.54 

PA AO ■ 1 0 nr 

50.33,12.45 


. 6 


40 00 

4/.1/ 


6 29 
10.34 




13 


PRE 
POST 


1 3 

' 3 


33 33 
44,33 


5 51 
5.69. 


2 PRE 
POST 


fi 6' 44.17 
" 5i 51.80 


6.21 
8.07 




47.17 
48.83 


9.75 
11.46 


11 I 


47.1713.42 
53.80il3.70 


,« 7 

12 ; 


45 14 
5?,83 


7 36 
9.21 




13 


PRE 
POST 


n 3 

2 

2 


47 00 

7/ I vy 

41.50 


16 37 

>U 1 J/ 

2.1? 


3 PRE 
POST 


, 6! 54.67 
' ■ 6: 51.83 


16.27 
10.76 


in 6| 43.66 
6' 48.67 


8.64 
11.09 


6 


37.20'' 7.79 
36.50 12.37 


« 6 

' 5 


43.50 
44,00 


9.38 
12.84 




13 


PRE 
POST 


« 5 
^ 5 


47.00 

7/ • vy 

46.00 


17 55 
11.111 


4 PRE 

flAPT 

POST 


3 ^ 
^ 6 


50.17 
54.50 


15.94 
7.89 


7 6145.67 
' 6157.17 


5.24 
i].21 


4 


39.20 8.53 
55.00 13.56 


, 5 


53.60 

• yy 

43.50 


12 50 

1 L 1 vy 

18.30 




13 


PRE 
POST 


10 ° 
b 


41.88 
SI. ,33 


10 88 
l?.45_ 


5 PRE 
POST 


c 6, 35.33i 6.22 
^ 5 46.00' 8.46 




48.67i i^.l5 
50.50: 15.74 


12 I 
5 


39.i7;13.89 
38.40, 9.91 


6 


NO 


DATA 




14 


PRE 
POST 


: 3 

5 

2 


37.33 
54.50 


7.23' 
2.1? 


6 PRE 
POST 


, 5l 46.20" 11.34 
' 5| 47.00 6.56 




50.33 
63.33 


7.17 
3.21 


4 


40.00il7.36 
42.7517.85 




35.20 
34.50 


15.98 
25.15 




15 


PRE 
POST 




53.50 
55.S0 


4.51 


■7 PRE 

POST • 


J, 6i 41.331 4.59 
° 4; 58.50; 8.74 




51.00 
51.40 


18.34 
10.04 


3 ' 

6 


52.33 
53.33 


5.61 
11.02 




50.75 
50.5/ 


9.60 
13,44 




15 


PRE 
POST 




50.50 
58.40 


7.55 i 
4.25! 


8 PRE 
POST 


,« 6: 43.33| 8.66 
5i 54.40' 88.80 




49.50j 15.50 
45.20' 10.33 


5 * 


41.60 
52.40 


10.24 
11.01 




51.83 
56.50 


7.91 
12.44 




15 


PRE 
POST 




44.90 
49.89 


9.24 
0.02. 


Q Dor 

: rKt 

POST 




51.33' 10.35 
57.33: 8.38 




42.50: 4.14 
50.33 8.78 


' I 


42.17il5.90 
54.50! 7.06 




57.00 
55.20 


1.41 
13.52 




15 


PRE 
POST 




44.43^' 
55.43 


7.61 
8.81 


10 PRE 
POST 




44.33 
47.67 


13.71 
11.45 


n 6^40.33: 16.91 

° 6' 57.83, 12.11 


' 5 


44.1718.35 
59.40' 7.67 


' 6 


38.75 
43.00 


11.93 
7.54 














11 PRE 
POST 




49.33 
47.17 


6.44 
7.08 




45.40, 12.44 
56.l7i 12.02 




38.67 
56.67 


17.56 
10.88' 




42.67 
42.17 


15.87 
14.82 














12 PRE 
POST 




47.00 
50.50 


7.80 
'7.87 




38.50 
39.75 


14.57 
24.50 




44.67 
58.00 


17.08 
11.40 




44.83 
51.33 


12.64 
11.40 














TREATMENT PRE 
EFFECT POST 




45.14 
52.75 


4.41 
4.30 




45.49 
52.01 


4.00 
6.31 




42.73 
50.84 


4.40 
7.54 




45.76 
47.44 


6.78 
6.72 






PRE 
POST 




44.43 
50.87 


6.25 
5.89 
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TABLE D-22 



yord Association Scale (Attitude toward Air Pollution) 
Study I Descriptive Statistics 



ECOLOGy 
TEACHER 


PROBING AND 
REDIRECTION 
TREATMENT 


NO PROBING AND 

REDIRECTION 

TREATMENT 

CLASS '7" 
^1 I SD 


FILLER 

ACTIVITY 

TREATMENT 


ART 

ACTIVITY 
TREATMENT I 




ypITTEN 

EXERCISE 

TEACHER 


WRITTEN 

EXERCISE 

TREATMENT 


ID 


mi 


SD 


"CLASS- 
N 


f ! SD 


N 


X 1 SD 




ID 




N 


X 


SD' 


"T" PRE 

POST 


'» 6 


55.17 
62.83 


5.60 
3.92 


^\ 


60.00 
52,20 


5.25 


9 ^ 

D 


'^7.67, 4.27 
fifi.nn; 6.20 




63.00 4.52 
fi?.3r ,144 




13 


PRE 
POST 




51.67 
58.00 


7.77 

fl.on 


n flTiP 

2 PRE 
POST 




55.83 
64.20 


11.07 
3.90 


^\ 


62.50 
58.50 


5.92 




59.17 

5(1 no 

JO 1 Uu 


4.22 

fl on 




58.14 
60,53 


7.63 
4,67 




13 


PRE 
POST 




58.00 
51), 50 


0.00 


3 PRE 
POST 


' \ 


54.67 
62.00 


16.27 
5.25 


\ 


49.33 
49.33 


9.54 

1? ifi 




59.40 
61.50 


14.03 
6.25 


Q 6 56.00 
^ 6 '55.33 


6.20 
^,52 




13 


PRE 
POST 




58.00 
58.00 


0.00' 
0.00 


4 PRE 
POST 




50.00 
61.67 


12.98 
2.94 


' \ 


57.67 
60.00 


2.25 
4.90 




51.60 
60.75 


7.54 
3.77 


4 5 
^ 4 


56.40 
56.25 


15.98 
2.87 




13 


PRE 
POST 


< 


54.30 
57.33 


8.05 
5.16 


5 PRE 
POST 




55.83 
60.80 


12.86 
6.26 




60.17 
61.50 


2.99 
4.81 




55.83 
60.40 


7.63 
6.84 


6 


NO 


DATA 




14 


PRE 
POST 




61.33 
66.00 


3.06 
2.83 


6 PRE 
POST 


7 5! 62.6d 5.27 
' 5 58.0d 4.24 


3 ' 


60.67 
60.67 


5.7S 
0.58 


, 5 
* 4 


58.00 
54.00 


10.17 
5.66 


8 5 


59.40! 3.58 
59.00; 2.83 






PRE 
POST 


3 ' 


56.33 
55.17 


6.65 
5,.67 


7 PRE 
POST 


„ 6i 56.6/1 4.63 
^ 4 SS.Od 8.48 


^\ 


56.00 
60.40 


11.58 
3.29 


3^ 


64.00 
64.00 


4.43 
5.37 


, 4.57.75: 0.50 
' 6 i 58.00' 0.00 




15 


PRE 
POST 




63.25 
54.60 


6.18 
18.43 


8 • PRE 
POST 


6 58.831 4.58 
i 60.60 2.61 


^\ 


50.50 
61.40 


12.61 
3.13 


^\ 


61.20 
52.40 


3.96 
12.52 


6^ 56.00' 9.57 
" 4i51.33Ml.86 




15 


PRE 
POST 




62.40 
59.22 


3.89 
2.73 


■ 9 PRE 
POST 


. 6 62.00 
^ 6' 63.00, 5.90 


^\ 


63.33 
60.83 


3.1; 


' 6 


62.00 
55.17 


3.16 
13.56 


loj 


46.50 
59.60 


17.00 
8.17 




15 . 


PRE 
POST 




60.19 
56.29 


7.03 
9.81 


10 m 

POST 


. 6; 60.0^ 5.73 
* 6' 58.50 6.89 


. 6| 60.00 
" 6 58.83 


2.45 
2.56 


' 5 


57.33 
56.00 


6.28 
9.82 


3: 


59.00 
57.33 


4.40 
4.13 














n PRE 

POST 


" 6! 56.33 


6.60 
5.99 


" 5 


60.40 
59.00 


2.4E 


^ 6 


61.50 
63.67 


3.89 
3.88 


^ 6 


56.00 
58.50 


12.51 
4.85 














12 PRE 
POST 


2 « 
^ 6 


57.50 


4.18 


9 ^ 
^ 4 


'58.67 
59.50 


4.6S 
3.0C 


10 6 


56.17 

55.67 


3.67 


' 6 


50.67 

60.17 


9.1s 
3.82 














TREATMENT PRE 
EFFECT POST 




57.67 
60.29 


3.76 
2.55 




58.27 
59.35 


4.36 
3.36 




58.65 
58.13 


3.33 
3.84 




56.26 
58.06 


4.42 
3.01 






PRE 
POST 




58.39 
'58.23 


3.83 
3.36 



TABLE D-23 

Word Association Scale (Attitude toward Alligators) 
Stydy I Descriptive Statistics 



ECOLOGY 
TEACHER 


PROBING AND 
REDIRECTION 
TREATHENT 


NO PROBING m 

REDIRECTION 

TREATHENT 

CLASS 

fj )( ^ SD 


FILLER 

ACTIVITY 

TREATMENT 


ART 

ACTIVITY 
TREATMENT I 




WRITTEN 

EXERCISE 

TEACHER 


WRITTEN 

EXERCISE 

TREATMENT 




CUSS 

N 


r — 

J 


j SD 


N 


I 


SD 


N 


I 


i SD 




ID 




N 


I 


SD 


1 m 

POST 




48.50 


10.7fi 
10.25 


1 6 
5 


36.33 
1 47.20 


10.84 
10.18 




43.00 
45.67 


7.24 
13.71 


^\ 


37.50 
47.00 


7.23 
9,25 




13 


'PRE 
POST 


1 3 


34.67 
42.00 


3.21 

4.35 


2 PRE 
POST 




41.00 
49.20 


10.35 
10.35 


5 5 
^ 6 


' 43.50 
44.33 


5.58 
1.51 




51.80 


13.71 
6.30 




34.33 
40.00 


12.43 
13.05 




13 


PRE 
PPST 


2 3 
^ 2 


45.67 

57,00 


10.41 

11.31 , 


3 PRE 
POST 


^ I 


33.67 
' 37.00 


10.33 
11.4D 


in 6135.67 
6145.83 


8.19 
12.42 


^ 6 


35.60 
33.33 


8.85 
r2.45 


'1 


37.83 
44.50 


12.89 
]2,03 




13 


PRE 
POST 




41.30 
4?,20 


6.94 

1,2.35, 


4 PRE 
POST 


, 6: 36.50 
6! 49.83 


14.87 
6.85 




' 43.17 
57.50 


12.37 
11.11 




31.80 
42.25 


7.66 
19.60 


'J 


37.40 
46.50 


8.85 
16.38 




13 


PRE 
PO$T 




35.38 
45,00 


11.99 
7.54 


5 PRE 
POST 




34.50 
40.20 


12.58 
7.98 




45.17 
52.33 


9.41 
5.92 




33.33 
38.60 


19.78 
12.86 


6 


NO 


DATA 




14 


PRE 

m 


5 3 


33.00 

4S.50 


10.44 
2.12 


6 PRE 

POST 




40.60 
44.20 


21.27 
4.76 




38,50 
51.67 


7.23 
5.Q3 




36.60 


13.89 

C\,i\ 


S 2 


39.80 

^1 cn 

ILbO 


16.04 
13.44 




15 


PRE 
POST 


6 


45.33 
51.00 


8.31 

f fit 

6.26 


/ PRE 
POST 


0 6; 40.67 
4 57.00 


4.41 
8.76 




43.00 
49.00 


11.83 
9.08 


3 ' 
' 6 


40.17 
42.17 


10.80 
14.66 




42.00 
34.67 


13.22 
14.11 




15 


PRE 
POST 


^\ 


41.00 
53.40 


19.13 
11.46 


8 PRE 
POST 


6 40.00; 8.45 
5' 49.40l 4.67 


« I 


48.75 
37.80 


7.68 
8.73 




33.60 
47.80 


14.93 
10.80 




44.33 
48.17 


10.78 
9.30 




15 


PRE 
POST 


10 
' 9 


40.30 
45.78 


9.36 
8.84 


9 PRE 
POST 


^ 6i 51.67i 11.81 


^ 6 


4i.5fl 

50.50 


11.18 




42.6? 
52.50 


16.29 
10.43 


,o| 


50.50 
51.20 


13.33 
14.65 




15 


PRE 
POST 


8 7 
7 


38.14 
44.57 


7.80 
4.69 


,10 PRE 
POST 


, 3?.Oo; 11.14 
^ ! 41 .831 8.8S 




39. 50 
50.67 


12.41 

12J2 




44.6? 
56.20 


9.fi5 
11.65 


^ 6 


28.75 
39.00 


6.99 
13.65 














11 PRE 
POST 




38.50 
53.67 


11.5 
9.44 




40.26 
52.67 


li/a 

11.^0 


. 6 
' 6 


36.67 
50.17 


18.16 
12.58 


5 ^ 
" 6 


43.17 
45.17 


16.34 
14.77 














12 PRE 
POST 




41.83 
44.33 


6.31 




37.75 


19.34 
23.56 


iO \ 


3/.S3 
44.17 


6.43 
8.84 


1 ^ 
' 6 


39.6; 
44.67 


10.1S 
15.06 














TREATHENT PRE 
' EFFECT POST 




39.09 
47.24 


3.64 
5.83 




40.13 
48.10 


5.48 
5.93 




37.80 
44.91 


4.10 
7.21 




39.58 
43.85 


5.63 
4.70 






PRE 
POST 




39.47 
48.49 


4.54 

4.66 



32? 

o 

ERIC 
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TABLE D-24 

Word Association Scale (Attitude toward Watfir Pollution) 
Study I Descriptive Statistics 



ECOLOGY 
TEACHER 



Ni I i SD 



PRE 
POST 



PROBING AND 
REDIRECTION 
TREATMENT 



10 



52.17 
61.00 



11.91 
3.29 



NO PROBING AND 

REDIRECTIOi^ 

TREATMENT 

CLASS - ■ , 
M X SD 



1 



6:59.50,4.97 
5 61.60 '5.37 



FILLER 

ACTIVITY 

TREATMENT 



CLASS 7 

N' X 



9 



6, 56.33 5.85 
6| 55.33110.25 



SD 



ART 

ACTIVITY 
h\ I I SD 



2 



6:63.67 
6 163.33 



3.88 



yRITTEN 

EXERCISE 

TEACHER 



ID 



13 



WRITTEN 
EXERCISE 
TREATMENT 

X 



PRE 
POST 



1 



49.33 
58.00 1 



PRE 

POST 



6 57.17 
5 64.80 



5.15 



6| 61.00 
s; 57.67 



PRE 
POST 



^ 56.33 
6 61.50 



14.28 
5.86 



10 



6:45.67 11.94 
6 49.83 12.14 



PRE 
POST 



& 51.00 
i 58.67 



14.83 
4.46 



6.29 



61 60.50 3.99 



?! 58.00 



58.40 
61.83 



6 56.17 5.49 
6: 60.00; 5.06 



8 



52.80 
60.25 



m 



12 



8.76 
6.15 



6 47.83 113.26 
6 53.83 7.49 



7.92 
4.50 



5 48.20 115.53 
4 51.25 In. 59 



56.43 |10.36 
fil-Ofl I 5.02 



13 



PRE 
ML 



ML 



13 



PRE 
POST 



58.60 
58.00 



13 



PRE 
POST 



10 



53.25 
55.50 



POST 



HOO 
^ 58.80 



TO 
9.26 



n 



619.50,2.35 H. 
6163.50 : 5.50 



52.33 



10.71 
6.00 



NO jOATA 



14 



PRE 
POST 



62.33 
66.00 



PRE 
POST 



5' 62.60 
5 57.00 



5.27 
5.10 



3 I 



ror3.83 



3 61.67 4.04 



4 



5 59.20 
4 55.75 



6.91 
2.87 



5 



58.40 I 2.19 
! 0.00 



2 58.00 



15 



PRE 
POST 



59.67 
58.3^ 



PRE 
POST 



4 59.001 



2.80 
3.46 



5^52.20 17.06 
5' 61.60 i 5.37 



60.83 
64.00 



"05 
5.37 



7 



4 59.75 



6 57 



2.87 
.50 ' 1.22 



15 



PRE 
POST 



66.25 
60.80 



"PIT 
POST 



12 



135 

2.61 



"TO 
5 61.00 I 3.74 



1 



5: 52.40 12.52 



II 



6 53.33 



7.39 
7.23 



15. 



PRE 
POST 
W 
POST 



10 
9 



59.90 
56.11 

7160.43 



POST 



6' 62.50 
T507 
6' 54.83 



6.50 



6 59.33:3.93 
6' 60.00 '3.10 



6 55. 



50 17.01 



ID 



5 59.60 



8.17 



15 



10 



POST 



9.11 



6 59.00' 1.67 
6 58.00 3.79 



5' 58.60 
6 61.33 
6 63.33 



6.15 



6 55.00 



717" 
9.92 



12 



TIT 
POST 



11 



& 58.33 



PRE 
POST 



6 61.00 
6 57.83 



TRE.ATM£;iT PRE 
EFFECT 



7.81 



12 



5 59.80,2.68 
6; 59.00 2.45 



IB 
3.98 



6 



W 
55.83 10.68 



6.42 
4.12 



6 52.83 
4 57.25 



57.05 



3.43 



59.57 



2.67 



56.74 



59.26 



7.05 
1.50 



10 



4.71 



3.52 



57.00 
56.67 



2.45 
2.42 



6 



55.83 
6 60.17 



58.33 
58.30 



3.33 

■'3.¥ 



56.08 
■57'.T7 



5.95 
3.37 



4.67 



PRE 
POST 



58.51 
59.18 



32^ 



339 ro 



TABLE D-25 

Gall-Crown Discussion Attitude Scale (Attitude toward Thought Questions) 
Stuf'y I Descriptive Statistics 



ECOLOGY 
TEACHER 



"■CLASS 



IT 

POST 
PRE 

POST 
TRT 

POST 



PRE 
POST 
H" 
POST 



PROBING AND 
REDIRECTION 
TREATMENT 



Ni X ! SD 



10 



■25.00 



.6 27.00 
5 26.60 



4.24 



31.50 

33,83 



3 



27.33 



4.38 
4.56 



4.97 
5.38 



3.01 



r 5, 28.17' 3.31 
^ 61 29.83! 8.45 



NO PROLING m 
REDIRECT :ori 
TREATMENT 

CLASS _ 



SD 



1 



6 30.50^ 6.22 
6 33.33' 6.28 



6 30.00 
MM 



3.03 

m 



10 



6 27.83 
4 33.25 



3.55 



7 6 25.00; 3.52 
6 30.67:6.44 
, 6 29.00, 4.65 
' ?9.17'6.21 



12 



FILLER 

ACTIVITY 

TREATMENT 



CLASS' 



SD 



ART 

ACTIVITY 
TREATMENT I 

tKfr^^ 

X i SD 



6 27.33:8.33 
6i 25.17 '7.47 



11 



6j 32.33 3.23 
5' ?fi.fin , d77 



5 30.80i3.11 
6| 30.83 5.08 



6 29.00 3.10 
5 29.10 2.fi1 



5 31.60:5.59 
5 30.20 1 4.82 



P 6 30.00 16.57 
6|3M7 ; $,19 



12 



7130.29! 8.67 



q 631.1715.85 
4i3D.25|fi.7n 



4 



5 31.80 '3.42 
4 32. 00 I 3.74 



NO iDATA 



yRIHEN 

EXERCISE 

TEACHER 

1 

ID I 



WRITTEN 
EXERCISE 
TREATMENT 
CWSS 

X ISO 



13 



PRE 
ML 



13 



PRE 
ML 



13 



PRE 
POST 



13 



PRE 
Ml 



14 



PRE 
M 



1 



3 



ii 



10 



7 



26.001 7.55 
24i7no,D2 



32.67| 6.66 



28.60| 4.34 
iUlUiL 



26.86i 6.99 



24.25 7.59 



TIT 
POST 
"PIT" 

POST 



7 



61 29.50 3.62 
6. 31.67! 3.56 



3 



fa; 2/. 17! 7.39 
6 31.171 7.91 



27.00, 2.61 
5 29.20U.66 



6 24.83105 



5 31.8016.61 



4 



4 27.50' 3.87 

5 25.60! 5.59 



4' 27.50 1 3.51 P 5 33120 



6! 29.33 



0; 



5.5 
9.79 



5| 29.20 
5128.20 



3.96 



3.11 
6.30 



15 



PRE 
POST 



15 



PRE 
POST 



23.33 



4.37 



26.20 
30.00 



6.94 
9i2 



PRT 

POST 

W 



12 



"007 

5i 



OF 
: 3.90 



6 30.6316.7$ 



POST 



9 



b 29.50 3.56 
6' 30.00: 8.53 



6 33.67 



5.24 



6 34.00^3.52 
6 37.83' 3.19 



61 23.33 1 3.93 
4 30.05 i 1.71 



II 



7 



6:27.6716.28 
6:34.83 1 6.24 



26.14 
7 28.57 



5 28.20 

6 28.66 



2.79 
2.82 



5.17 
6.59 



15 



I PRE 
POST 



15 



PRE 
POST 



30.11 



29.71 
30.13 



5.95 
6.7Q 



3.86 
4.73 



.10 



12 



PRE 
POST 



PRE 
POST 



4 6, 27.33! 4.84 
5 27.6Qi m 



6! 
41 



4.15 



5 30.50 6.03 
4 3 8,25 4 .57 



6i 28.33 i 2.07 



i 



PRE 
POST. 



12 



5 29.20: 7.79 
^ 28. 2 0 6 .83 



TREATMENT PRE 
EFFECT POST 



33.17' 2.64 



35.17 



28.57 
31.56 



4.49 



5 32.33 
5 29.67 



5 30.40 
ML 



i 



2.41 
2.93 



29.47 
31.57 



2.80 

ML 



5 



2.45 
3.81 



ML 



26.17 



28.05 
29.87 



HI 



6 26.50 



2.88 
UL 



3.78 



6 



27.00 



i2ML 



1.17 



6 27.33 



2.90 
2.84 



7.64 
Ail 



4.18 
141 



29.04:2.12 
30.33 12.67 



331 



PRE 
POST 



27.6 
28.60 



11 ^,09 
3.07 



ro 
o 



ERIC 
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TABLE 

fiall-Crown Discussion Scale (Attitude toward Discussion) 
Study I Descriptive Statistics 



.ULOBl 

;acher 


PROBING AND . 

REDIRECTION 

TREATMENT 


NO PROBING AND 

REDIRECTION 

TREATMENT 


FILLER 

ACTIVITY 

TREATMENT,. 


ART 

ACTIVITY 
TREATMENT I 




WRIHEN 
EXERCISE 
TEACHER 


WRITTEN 
EXERCISE 
TREATMENT 


CLAbb 

N 


X 


1 

\ SD 


CLASS 

N 




SD 


CLASS 

N 


X 


SD 


CLASS 

N 


x 


SD 




ID 




m 

N 


X 


SD 


PRE 
DELAY 


1 n 0 

6 


47 .33 
47.00 


10.61 
4.29 


' 6 


fin nn 

uu« uu 

60.50 


9.18 


.» 6 


30. 00 

45.67 


o.ll 
11.81 




61 33 

50,17 


7 S"! 

lO.Ol 




13 


PKt 

DELW 


1 ^ 
' 3 


DO. 00 

51,00 


C CI 

3.51 

5.54 


PRE 
• DRAY 


^ 5 


53.00 
47.60 


4.82 
5.94 


5 5 


58.33 
54.40 


2.66 
3.44 


„ 6 
" 5 


54.33 
55.20 


5.75 
3.35 


7 


56 57 
52.67 


in u 
10.53 




13 


hnr 

PRE 
DELAf 


2 ^ 
3 


56.33 


1 01 

/.2I 


PRE 
DELAY 

— trhWll,.., 


1 6 


62.33 
61.17 


2.50 
11.58 


10 , 
4 


51.67 
56.75 


8.02 


fl 5 
2 

L 


60 2fl 
59.33 


OiO/ 

11.11 




j3<oj 

5100 


7 7Q 

6.2? 




13 


PRE 
DPI AY 


r 

' I 


55.20 
54.20 


5.26 
ML 


PRE • 

DELAY 


^ 6 


47.83 
50.33 


6.01 
5.32 


7 6 

' 6 


50,67 
51.67 


8.76 
7.86 


« 5 


JJi JJ 

57.20 


fl in 
7,36 


4 ^ 

n 


w 9n 
51.00 


o./U 

6.4a 




13 


PRE 
DPI AY 


'» I 


48.00 
.%.Ofi 


12.73 
liOl 


PRE 
DELAY 




54.67 
54.17 


2.50 
9.15 


" I 


52.83 
54.50 


9.60 
9.98 




58.20 
54.20 


9.36 
7,85 


6 


NO 


DATA 




14 


PRE 




53.50 
1? fin' 


3.87 

f Iff) 


PRE 
DELAY 




53.33 
51.83 


8.14 
10.57 




53.17 
55.40 


5.67 
4.83 




45.83 
46.50 


9.33 
9.11 




55.20 
58.40 


8.20 
11.42, 




15 


PRE 
DELA! 




47.50 
47.25 


,6.89 
12.09 


PRE 

- m 




54.50 
58.67 


13.03 
9.48 


' I 


46.75 
52.80 


6.40 
2.59 


3 ' 


46.83 
52.33 


5.67 
10.01 




54.00 
53,20 


8.60 
11.22 




15 


PRE 
DELAY 




54.20 
5,140 


9.78 
lfl.4.1 


PRE 

DELAY 




56.00 
50.60 


6.8) 
8.05 


s 6 
' S 


57.50 
58.17 


8.50 
10.61 




51.17 
55.00 


4.26 
5.03 




49.43 
52.71 


4.58 
2,75 




15 


PRE 
DELAY 




55.89 
54.00 


8.03 
9.77 


PRE 
DELAY 


'1 


53.50 
52.00 


7.12 
12.46 


' 6 


64.50 
65.50 


3.45 
6.35 




59.83 
65.67 


3.19 
8.21 




51.20 
54.67 


6.72 
9.81 




15 


PRE 
DELAY 


'I 


59.86 
57.25 


59.93 
5,54 


PRE 
DELAY 




50.33 
52.60 


"6.35' 
2.70 


" 4 


54.83 
66.75 


13.82 
7.63 




54.50 
51.67 


5.24 
9.67 


3 ' 
' 5 


50.17 
44.60 


10.01 
14,42 






PRE 
DELAY 








PRE 
DELAY 




53.00 
65.75 


6.93 
4.27 




55.80 
54.00 


)2.40 
7.38 


^ 6 


57.20 
59.50 


6.98 
7.53 




53.83 
56.33 


8.04- 
8.04 






PRE 
DELAY 








PRE 
DELAY 




63.83 
65.50 


5.85 
5.65 




59.67 
55.67 


5.13 
12.29 


10 6 


48.83 
52.50 


2.40 
3.36 




52.83 
fi0.17 


8.16 
!r.?l 






PRE 
DELAY 








.THENTPRE 
CT DELAY 




54.30 
57.68 


5.86 




55.47 
57.13 


4.85 
4.85 




53.84 
54.56 


4.82 
5.56 




54.14 
54.08 


3.34 
4.50 






PRE 
DELAY 




54,6r 
53.69 


4.59 
3.04 
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TABLE D-27 

Ecology Unit Opinions (Attitude Toward Peers) 
Study I Descriptive Statistics 



ECOLOGY 
TEACHER 


PROBING AND 
REDIRECTION 
TREATMENT 


NO PROBING AND 

REDIRECTION 

TREATMENT 


FILLER 
ACTIVITY 
■ TREATMENT 


ART 

ACTIVITY 
TREATMENT I 


• 


WRIHEN 

EXERCISE 

TEACHER 


WRITTEN 
EXERCISE 
TREATMENT 


To" 


N 


J 


i SD 




I 


SD 


CLASS 

M 

r 


7 

A 


SD 


CLASS 

III 


J 


SD 




ID 




It 

N 


7 




r 

POST 


10 6 


12.00 


2.83 


1 5 


16.20 


2.59 


9 6 


14.67 


3.67 


2 6 


18 50 


1 76 

i 1 f u 




13 


pfl<;T 

rUJl 


1 1 


ID 


1 CO 


POST 


6 5 


12.40 


5.19 


5 6 


10.00 


2.76 


11 5 


14.80 


2.86 , 


12 7 


14^6 


1 57 




13 


POST 


? 1 
t J 


ID n 
lo»o/ 




3 

POST 

., 


1 6 


16.83 


1.94 


10 6 


15.00 


2.76 


2 6 


18.83 


1.60 


9 6 


13.67 


5.39 




13 


POST 


J D 


1? fin 




POST 


3 6 


12.33 


2.80 


7 6 


17.83 


2.48 


8 6 


14.17 


5.19 


4 5 


17.20 


2.95 




13 


POST 

r 1 


10 7 


ifi nn 




5 

POST 


5 5 


17.00 


2.45 


11 6 


14.00 


5.37 


12 5 


16.40 


3.51 


6 


NO 


DATA 




14 


POST 


5 4 


13.00 


3.46 


POST 


7 6 


18.00 


1.55 


3 5 


15.80 


2.95 


4 6 


13.50 


2.35 


8 4 


14.75 


1.50 




15 


POST 


3 6 


15.83 


0.75 


7 . 

POST 


8 6 


17.17 


1.47 


4 6 


16.33 


2.58 


3 5 


16.80 


3.49 


7 5 


18.20 


2.05 




15 


POST 


4 5 


16.40 


4.39 


^ POST 


12 6 


19.67 


0.52 


6 6 


17.17 


3.49 


5 4 


18.50 


2.38 


n 7 


14.14 


2.67 




15 


POST 


7 10 


17.60 


2.12 


' POST 


9 6 


16.50 


4.13 


2 6 


19.17 


0.98 


1 5 


18.20 


1.64 


10 5 


18.60 


1.95 




15 


POST- 


8 7 


12.43 


3.41 


^ POST 


4 6 


14.83 


3.71 


8 6 


18.67 


2;'l6 


7 4 


17.25 


1.26 


3 6 


15.00 


4.20 














' POST 


11 6 


15.50 


3.45 


12 6 


16.50 


2.59 


6 6 


18.33 


1.86 


5 6 


18.00 


'2.10' 














POST 


2 6 


18.33 


1.75 


9 5 


17.00 


2.00 


0 6 


15.50 


3.40 


1 5 


15.20 


5.45 














mm POST 

•ECT 




15.88 


2.52 




16.14 


2.41 




16.41 


1.86 




16.19 


i.91 






POST 




16.00 


2.15 
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TABLE D-28 



Ecology Unit Opinions (Attitude Toward Ecology Teacher) 
Study I Descriptive Statistics 



ECOLOGf 
TEACHER 


PROBING AND 
REDIRECTION 
TREATMENT 


NO PROBING AND 

REDIRECTIOfJ 

TREATMENT 


FILLER 

ACTIVITY 

TREATMENT 


ART 

ACTIVITY 
TREATMENT I 




WRr'^:"N 

EXERCISE 

TEACHER 


1 

yRITTEN 

EXERCISE 

TREAT^!ENT 


10 


cres 

N 


! 


SD 


CLASS 

N 




SD 


CLASS 

N 


J 


SD 


iLAsT 
N 


r 


SD 




ID 




-LASS 

N 


X 


so' 


^ POST 


10 6 


54.67 


13.00 


1 5 


60.00 


2.92 


9 6 


58.67 


5.75 


2 6 


61.50 


l.,76 




13 


POST 


1 3 


61.33 


4.62 


^ POST 


6 5 


49.60 


12.82 


5 6 


55.17 


10.74 


11 5 


49.20 


12.60 


12 7 


51.00 


11.80 




13 


POST 


2 3 


62.67 


2.31 


^ POST 


1 6 


57.83 


5.98 


10 6 


52.00 


10.08 


2 6 


60.83 


3.25 


9 6 


41.17 


13.51 




13 


POST 


9 5 


57.60 


5.22 


POST 


3 6 


54.00 


5.80 


7 6 


61.50 


3.33 


8 6 


50.83 


8.11 


4 5 


54.60 


7.77 




13 


POST 


10 7 


52.29 


11.91 


^ POST 


5 5 


57.80 


7.40 


11 e 


56.17 


10.61 


12 5 


51.80 


12.01 


6 


NO 


DATA 




14 


POST 


5 4 


53.75 


2.63 


^ POST 


7 6 


59.83 


3.55 


3 5 


59.00 


6.00 


4 6 


53.00 


8.74 


8 4 


51.50 


11.96 




15 


POST 


3 6 


61.50 


2.59 


^ POST 


8 6 


52.67 


10.23 


4 6 


55.33 


6.38 


3 5 


62.80 


1.64 


7 5 


61. '10 


129 




15 


POST 


4 5 


59.00 


8.66 


^ POST 


12 6 


55.33 


9.61 


6 6 


56.83 


8.77 


5 4 


60.50 


6.35 


11 7 


52.71 




15 


POST 


710 


61.90 


'2.08 


^ POST 


9 6 


53.67 


10.17 


2 6 


61.50 


2.88 


1 5 


61.40 


3.13 


10 5 


54.20 


11.73 




15 


POST 


8 7 


55.29 


7.65 


POST 


4 6 


53.67 


9.61 


8 6 


59.00 


6.39 


7 4 


61.25 


2.50. 


3 6 


48.00 


7.04 














POST 


11 6 


61.33 


1.97 


12 6 


54.17 


12.20 


6 6 


59.67 


4.18 




5 6 


58.33 


3.93- 














POST 


2 6 


60.17 


4.02 


9 5 


60.20 


1.79 


10 6 


49.83 


12.73 


1 5 


58.60 


6.77 














TREATMENT POST 
EFFECT 




55.88 


3.52 




57.57 


3.07 




56.65 


5.22 




54.45 


4.99 






POST 




58.37 


3.85 
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TABLE D-29 

Ecology Onit Opinions (Attitude Toward Ecology Curriculum) 
Study I Descriptive Statistics 



ECOLOGy 
TcACHtK 


PROBING AND 
REDIRECTION 
TREATMENT 


NO PROBING AND 

REDIRECTION 

TREATMENT 


FILLER 

ACTIVITY 

TREATMENT 


ART 

ACTIVITT 
TREATMENT I 




WRITTEN 

EXERCISE 

TEACHER 


WRITTEN 

EXERCISE 

TREATMENT 


10 


CLASS 

N 


! 


SD 


CLASS 

N 


J 


SO 


CLASS 

N 




SO 


L'LASr 

N 


J 


SD 




ID 




lAsr 

N 


I 


SD 


POST 


10 6 


26.17 


7.00 


1 5 


33.80 


1.92 


9 6 


28.67 


6.25 


2 6 


33.83 


2.64 




13 


POST 


1 3 


32.33 


4.73 


2 

POST 


6 5 


25.20 


3.96 


5 6 


27.83 


5.53 


11 5 


29.60 


6.02 


12 7 


26.86 


9.46 




13 


POST 


2 3 


33.00 


1.00 


3 

POST 


1 6 


34.33 


1.86 


10 6 


28.83 


5.85 


2 6 


33.83 


1.83 


9 6 


28.17 


6.59 




13 


POST 


9 5 


33.00 


4.06 


4 

POST 


3 6 


24.67 


7.84 


7 6 


31.50 


4.76 


8 6 


27.83 


6.18 


4 5 


27.60 


6.15 




13 


POST 


10 7 


29.86 


5.73 


5 

POST 


5 5 


28.80 


8.93 


11 6 


28.83 


9.04 


12 5 


28.60 


6.91 


6 


NO 


DATA 




14 


POST 


5 4 


24.00 


4.32 


POST 


' D 




? 71 
L,l\ 


3 i; 


1) An 

01 .DU 




L ^ 
^ D 


:0.!)U 






2/. 50 


8.2/ 






POST 


3 6 


33.83 


1.94 


POST 


8 6 


28.67 


6.19 


4 6 


29.33 


5.28 


3 5 


30.80 


6.61 


7 5 


32.80 


2.49 




15 


POST 


4 5 


30.20 


8.31 


^ POST 


12 6 


30.50 


5.92 


6 6 


31.33 


5.50 


5 4 


29.00 


5.48 


n 7 


30.00 


5.26 




15 


POST 


7 10 


33.80 


2.74 


^ POST 


9 6 


30.67 


5.57 


2 6 


35,67 


0.52 


1 5 


34.20 


1.30 


10 5 


32.40 


4.98 




15 


POST 


8 7 


27.71 


7.23 


POST 


4 6 


28.17 


5.56 


8 6 


34.50 


3.67 


7 4 


32.25 


4.50 


3 6 


24.33 


6.80 














POST 


11 6 


35.00 


1.10 


12 6 


30.33 


3.98 


6 6 


32.83 


4.26 


1 

5 6 


.29.50 


3.57 














^2 POST 


I 6 


34.67 


0.82 


9 5 


32.80 


5.07 


10 6 


27.33 


8.24 


1 5 


32.80 


2.39 














TREATMENT POST 
EFFECT 




29.97 


3.66 




31.36 


2.47 




30.12 


2.61 




29.62 


3.04 






POST 




30.86 


3.30 
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TABLE 0-30 

Ecology Discussion Attitude Scale (Attitude toward Thought Questions) 
Study I Descriptive Statistics 



ECOLOGy 
TEACHER 


PROBING AND 
REDIRECTION 
TREATMENT 


NO PROBING AND 

REDIRECTION 

TREATMENT 


FILLER 

ACTivny 

TREATMENT 


CESSS 

N' 


j 

I 


SD 


aAss 

N 




SD 


CLASS 

N 


J 


SD 


1 

POST 


10 5 


25.20 


6.38 


1 4 


33.50 


3.70 


A M 

9 6 


,28.83 


8,06 


2 


6 5 


29.60 


3.05 


5 6 


30.67 


,3.67 


11 5 


30.00 


5.61 


3 

pn<;T 


1 6 


33.33 


2.80 


10 6 


30,00 


4.47 


2 6 


34.50 


5.17 


Pfl^T 

rUJl 


3 6 


30.00 


8.10 


1 6 


29.50 


8.19 


8 5 


34.40 


2.30 


5 


5 6 


32.17 


5.78 


11 6 


30.17 


8.75 


12 4 


33.25 


5.25 


6 

rUjI 


1 6 


35.00 


A Art 

2.28 


3 4 


AA AT 

33.25 


A AT 

3.86 


4 4 


AY AA 

31.00 


4.55 


7 

ruj 1 


8 5 


32.40 


8.65 


4 5 


30.80 


6.50 


3 6 


28.67 


9.63 


8 

POST 


12 6 


33.83 


5.49 


6 6 


36.83 


6.77- 


5 5 


34.00 


4.85 


9 

POST 


9 6 


29.33 


7.74 


2 6 


38.83 


3.13 


1 6 


37.00 


4.98 


10 

POST , 


4 6 


29.33 


3.39 


8 5 


37.20 


6.98 


7 5 


34.60 


4.15 


11 

POST 


11 6 


35.17 


4.75 


12 5 


35.20 


4.60 


6 6 


36,00 


5.66 


12 

POST 


2 5 


33.40 


8.68 


9 5 


32.40 


7.89 


10 6 


27.50 


4.59 


TREATMENT 
EFFECT 




31.56 


2.93 




33.19 


3,18 




32.23 


3.10 



TABLE 0-31 

Ecology Discussion Attitude Scale (Attitude toward Discussion) 
Study I Descriptive Statistics 



tlULUbi 
TEACHER 


PROBIfiS AfiO 
REDIRECTION 
TREATMENT 


NO PROBING AND 
REDIRECTION 
TREATMENT - 


FILLER 

ACTIVITY 

TREATMENT 


"Td"" 


CLASS 

N 


x 


! SO 




u 

A 


— ■ — » - 

SD 


CLAS$ 

N 


x 


SD 


1 

POST 


in 1^ 


fin 


\L%lL 


1 t 


fil nn 


in nQ 
lU.Uo 


9 D 


34. uu 


7 on 

/.OU 


2 

POST 


0 <j 




^ 9i 


9 D 


nn 


0. 13 


II 3 


30 


0.1)/ 


3 

POST 


1 V 




1^ 19 


in (; 

lU 3 


w en 


fl on 






Q 7^1 

y./o 


4 

POST 


^ 6 

J u 




OiOU 


7 fi 


fi7 


11 QQ 


8 3 




fi fifi 


5 

POST. 








n fi 

1 1 D 


w nn 


19 fi9 


12 


fil nn 
01 .uu 


fi 90 


6 

POST 


7 6 


5Q Of) 


fi ^7 




fil 7^ 


7 fi^ 


4 


fi9 OK 


fi Ifi 
Oi 10 


7 

POST 


8 5 


58.20 


11.84 


4 5 


55.00 


8.94 


3 6 


53.67 


14.95 


8 

POST 


12 6 


■61.83 


7.52 


6 6 


64.17 


12.04 


5 5 


57.20 


10.31 


^ POST 


9 6 


53.50 


14.99 


■2 6 


70.17 


3.49 


1 6 


66.83 


6.18 


DflCT 
PUbl 


4 6 


5y.l7 


8.86 


8 5 


66.40 


8.20 


7 5 


59.60 


10.95 


POST 


11 6 


63.83 


9.28 


12 5 


64.40 


6.19 


( 6 


61.17 


8.28 


12 

POST 


2 5 


66.60 


3.91 


9 5 


60.60 


9.63 


0 6 


54.33 


10.48 


TREATMENT ''^^^ 
EFFECT 




6y.68 


5.86 





60.41 


5.28 




57.62 


4.57 



TABLE D-32 



Written Exercise Attitude Scale 
(Attitude toward Thought Questions and Written Exercises) 
Study I Descriptive Statistics Written Exercise Treatment 



hCOLuSY 
TEACHER 


AHITUDE TOWARD 
THOUGHT QUESTIONS 


ATTITUDE 
TOWARD 

■ DISCUSSIONS 


ID 


CLASS 
N 


X 

A 


JU 


X 




1 

POST ' 


1 3 


JO (00 


0. 14 


42.67 


5.03 


2 

POST 


2 2 


JO* UU 


n nn 

u.uu 


39.50 


2.12 


3 

POST 


9 5 


34.00 


6 44 


39.00 


5.66 


4 

POST ' 


:10 7 


30.43 


6 24 


32.71 


6.18 


5 

POST 


5 4 


20.00 


7.07 


21.50 


7.14 


6 

POST 


3 5 


31.00 


5.20 


35.80 


5.26 


7 

POST 


4 4 


34.25 


8.42 


39.75 


6.40 


8 

POST 


7 10 


33.80 


4.13 


37.90 


4.86 


9 

POST 


9 7 


30.29 


3.77 


33.57 


7.39 






































TREATMENT POST 
EFFECT 1 




31.68 


4.99 


35.82 


6.23 



TABLE D-33 

Ecology Art Project Scale (Attitude toward Art Projects) 
Study I Descriptive Statistics 



ECOLDGY 
TEACHER 


ART 

ACTIVITY 
TREATMEN' 


T I 


ID 


CLASS 
N 


X 


SO 


^ POST 


2 5 


66.40 


7.23 


2 POST 


12 7 


59.00 


13.00 


^ POST 


9 6 


61.67 


10.61 


^ POST 


4 3 


64.33 


8.33 


^ POST 


6 j m 


DATA 

1 


^ POST 


8 5 


71.10 


3,16 


7 POST 


7 5 


62.40 


9.71 


^ POST 


11 7 


60.14 


10.64 


^ POST 


10 5 


59.20 


6.14 


POST 


3 o| 


46.33 


5.57 


1 • POST 


f 

5 6 


63.33 


10.56 


^ 2 POST ■ 


1 5 


66.60 


9.66 


EFFECTIVE POST 
TREATMENT 




61.35 





TME 0.31 

Nuier of Treatment Sessions Attended 
Study I Descriptive Statistics 



ECOLOGY 
TEACHER 


PROBING AND 
REDIRECTION 
TREATMENT 


NO PROBING AND 

REDIRECTION 

TREATMENT 


FILLER 

ACTIVITY 

TREATMENT 


ART 

ACTIVITY 
TREATMENT I 




WRIHEN 

EXERCISE 

TEACHER 


WRITTEN 

EXERCISE 

TREATMENT 


To" ~" 


CLASS 

N 


f 


SD . 


ml 

N 




SD 


N 


X 


SD 


CLASS 

N 


J 


SD 




ID 




m 

N 


I 


SD 


1 


10 6 


7.33 


3.89 


1 6 


9.33 


0.82 


9 6 


7.67 


1.63 


2 6 


9.67 


0.82 




13 




13 


9.00 


1.00 




6 6 


9.83 


0.41 


5 6 


9.83 


0.41 


11 6 


9.33 


0.82 


12 7 


9.71 


0.49 




13 




2 3 


9.00 


1.73 


3 


] 6 


9.00 


1.26 


10 6 


9.00 


0.89 


2 6 


9.33 


0.82 


9 6 


9.00 


2.00 




13 




9 5 


9.60 


0.89 


4 


3 6 


8.83 


1.94 


7 6 


9.67 


0.82 


8 6 


8.00 


2.45 


4 5 


9.60 


0.55 




13 




10 8 


9.38 


0.74 


5 


5 6 


9.83 


0.41 


11 6 


9.83 


0.41 


12 6 


7.50 


3.83 


6 


NO 


DATA 




14 




5 5 


9.40 


0.89 


6 


7 6 


8.17 


2.23 


3 6 


9.83 


0.41 


4 6 


9.00 


1.55 


8 5 


9.00 


0.71 




15 




3 6 


9.67 


0.52 


1 


8 6 


3.83 


1.60 


4 6 


8.50 


1,64 


3 i 


9.33 


1.21 


7 6 


9.17 


1.33 




15 




4 5 


9.00 


1.00 


a 
0 


12 6 


9.00 


1.10 


6 6 


9.17 


1.17 


5 5 


8.80 


1.64 


11 7 


9.86 


0.38 




15 




7 10 


9.20 


1.03 


9 


9 6 


10.00 


0.00 


2 6 


9.17 


1.33 


1 6 


9.67 


0.52 


iO 6 


9.50 


0.55 




15 




8 8 


8.88 


1.55 


0 


4 6 


9.00 


1.67 


8 6 


9.50 


0.55 


7 6 


8.83 


1.33 


3 6 


9.67 


0.52 














1 


11 6 


9.50 


0.84 


12 6 


9.50 


0.84 


6 6 


9.17 


1.33 


1 

5 6 


9.67 


0.82 














2 


2 6 


9.00 


1.10 


9 6 


8.83 


1.47 


10 6 


9.83 


0.41 


1 6 


0.50 


1.64 














lEATMENT 
FECT 




9.03 


0.75 




9.34 


0.43 




8.87 


0.76 




9.39 


0.42 










9.23 


0.29 
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Compretitinsive Test of Basic Skills (Vocabulary, Comprehension, and Total Reading Score) 

Study II Descriptive Statistics 



ECCIOGY 
TEACHER 


HIGHER 
COGNITIVE QUESTIONS 
TREATMENT II 


50X HIGHER 
COGNITIVE QUESTIONS 
TREATMENT II. 


75^ HIGHER ' 
COGNITIVE QUESTIONS 
TREATMENT 11 


ART ACflVITy 
TREATMENT 11 


ID 


LLASS 

1 


t 


SO 


CLASS 

N 


J 


SO 


CLASS 

N 


I 


SO 


CLASS 

N 


X 


SD 


1 VOCAB,"" 
COMP. 
TOTAL 


28 6 

0 


32.50 

26.17 

W fi7 


5.'fi8 
10.26 

K CO 

Is.!)? 


21 5 

0 


mi} 

34.00 


2.59 
4.18 

D.3'1 


5 

22 5 

3 


36.60 

39.00 
71; on 


5.94 
2.00 

• 7 70 


K 

27 1( 
If 


28.40 
30.80 

no on 


6.22 
9.20 

13. 16 


COMP. 
TOTAL 


"5 

32 5 

C 

0 


28.fi0 
29.80 

W AO 
JC3.4U 


5.46 
8.70 

1^ QQ 


5 

25 5 

0 


31.40 
30.40 

01. oU 


5.13 
9.21 

l£.0o 


5 

31 5 

c 
3 


34.40 

37.20 
71 

/l.bU 


1.82 

4.55 
^ 79 


i; 

26 i; 


31.46 
34.38 

63.03 


7.24 

6.86 

n cc 
11.33 


3 VUIA^'. 
COHP. 
TOTAL 


24 6 
6 


32.17 
33.67 
65.83 


9.91 
10.50 

OA 1 A 

20.10 


4 

29 4 
4 


00 oc 

35.75 

AA 

68.00 


4.99 
4.35 

A 01 

9.31 


6 

30 6 
6 


32.00 
39.17 

*J^ 17 

71.17 


6.00 
20.15 

1 0 f /" 

12.66 


1- 

23 i: 

1 ^ 

1: 


35.46 
38.31 
73.77 


3.66 
4.33 

T 0 0 

7.82 


4 VOCAB. 
COMP. 
TOTAL 


6 

22 6 
6 


35.50 
37.33 
72.83 


4.76 
3,98 
8.23 


6 

27 6 
5 


30.33 
33.17 

ro ro 

63.50 


5.01 
9.11 
14.94 


6 

21 6 
6 


28.17 
27.33 
55.50 


8.23 
9.02 

1 1 In 

17.10 


£ 

28 J 


31.00 
32.00 
63.00 


10.00 
10.36 
19.84 


5 VOCAB. 
COMP. 
TOTAL _ 


4 

23 4 
4 


31.75 
32.25 
64. UU 


5.44 
4.79 

A AO 

9.83 


6 

■30 6 
6 


33.17 
35.33 

CO TA 

68.50 


6.46 
5.32 

11 AO 

11.48 


6 

24 6 
6 


32.00 
36.83 

ro oo 

68.83 


4.86 
4.66 

1 00 

7.83 


1^ 

29 1^ 

1 n 

V 


29.64 
33.43 

rO AT 

63.07 


9.18 
7.01 

1/1 An 

14.98 


6 VOCAB 
COMP 
TOTAL ■ 


6 

30 6 

r 
0 


31.00 
34.50 
00. DU 


6.32 
5.47 
11. 54 


6 

23 6 

■ 6 


29.17 
32.17 

CI 00 

51.33 


6.24 
10.48 
16.48 


6 

29 6 

6 


27.00 
30.17 

C7 17 


3.63 
7.44 
3.95 


u 

24 1[ 

1 1 

IL 


34.50 
37.20 

l^ 7ft 

71.70 


4.17 
5.07 

0 A/I 

8.94 


7 VOCAB 
COMP 
TOTAL 


' "5 

31 5 

C 

0 


31.2fi 

34.00 


10.21 

9.30 

10 00 

lo.89 


6 

26 6 
b 


30.33 
34.33 


6.65 
9.22 

1 c 


6 

25 6 
6 


32.83 
36.33 

Cft 17 

69.1/ 


5.31 
6.44 

1ft IC 

10. lb 


7 

32 7 

/ 


28.43 
32.57 

c^ ftft 

51.00 


2.22 
5.56 

7 no 


8 VOCAB 
COMP 
TOTAL 


26 6 

C 

0 


27.53 

25.67 


10.71 
ib./y 


■ 6 

31 6 

C 

0 


iO.b/ 
36.33 
o/.UU 


z.Sfl 

4.55 
3. by 


32 6 

c 
b 


3().83 

33.17 

c^ Oft 
b4.l)U 


IM 

6.46 

1 j.3c 


IC 

25 IC 

1/1 


33.50 
35.50 

CO ftft 

by.uu 


5,85 
5.10 

C 7ft 

b./U 


VOCAB"" 
9 COMP 
TOTAL 


"b 

29 5 

C 

D 


31.00 


/.33 

10.22 
17 ^^ 


24 5 

0 


ji!.2u 
35.20 

D/.'IU 


5.12 
in 71 


- 

23 6 

C 

D 


"25:i7 
32.67 

CI 00 


b./9 
9.02 

I3.30 


m 

30 11 

n 
1 1 


24.54 
26.27 

^(\ Ql 

31). yi 


7.1S 
9.61 

Ifi 90 

io*^y 


VilUB " 
10 COMP 
TOTAL 


5 

25 5 
5 


26.80 
26.80 
53.60 


3.83 
12.34 
15.68 


4 

32 4 
4 


31.50 
33.00 
64.50 


3.70 
4.76 
8.35 


6 

26 5 
6 


29.00 
33.00 
62.00 


5.18 
4.47 
9.01 


31 9 
q 


25.00 
46.22 
71.22 


13.22 
25.62 
24i4 


VOCAf 
11 COMP 
TOTAL 


21 5 
5 


31.00 
60.80 


3.0/ 

5.10 
8.96 


g 

28 6 
■ 6 


u nn 

J4.UU 

39.33 
68.50 


17.74 
19.68 


c 

3 

27 5 
5 


^o.ou 
30.00 
58.80 


7 7Q 
13.55 
20.33 


22 14 


^9 fid 

36.28 
68.93 


4.30 

3.38 
6,75 


VflCAS 
12 COMP 
lUIAL 


1 
27 6 
6 


2$.M 
33.50 
62.50 


li.Sfi 

11.73 
23.18 


22 6 
6 


29.50 
30.17 
59.67 


4.14 

3.87 
7.58 


4 

28 4 
4 


17.50 
15.50 
33.00 


5.5/ 
6.66 
11.34 


21 i: 


27.92 
28.46 
56.38 


Ub 

7.40 
12.70 


TREATMENT VOCAB 
COHP 

; EFFECT TOTAL 




30.38 
31.30 
61, 


2.44 
3.64 
5.50 




31.22 
34.10 
..&L22. 


1.47 
2.57 
_L2I 




29.86 
32.53 


4.78 
6.54 

m 




30.21 
34.28 

64.43 


3.51 
5.15 
6.61 



mil t-i 



Ecology Infomation Test (Total Scale) 
Study II Descriptive Statistics 



ECOLOGY 
TEACHER 



25% HIGHER 
COGNITIVE O'JESTIONS 
TREATHENT II 



ID 



T 



PRE 

POST 

DELAY 



PRE 

POST 

DELAY 



"prT 

POST 
DELAY 



PRE 

POST 

DELAY 



IT" 

POST 
DELAY' 



POST 
DELAY' 



TT" 

POST 
DELAY 



POST 
DELAY 



PRE 
POST 

m 



10 



PRE 

pOo: 



11 



HRE 

POST 

DELAY 



12 



ERIC 



PRE 

POST 

DELAY 



TREATHENT 

POST 

EFFECT 



28 6 



32 6 



24 6 



22 6 



23 6 



30 5 
6 



31 5 
5 



~1 

26 6 
6 



6 

29 6 



25 5 
__1 



6 

21 6 
6 



6 

27 6 
6 



X 



10.67 
16.B7 

m 



10.67 
17.33 
16.00 



SD 



2.16 
2.16 
3J9 



9.67 
15.67 
17.50 



15.00 
22.00 
22.00 



TOT 

18.00 
18.50 



20.80 
18.00 



m 

18.80 
16.60 



TOJ 
18.00 
16.83 



9,83 
15.17 



18.60 



10.50 
17.83 



11.67 
17.00 
17.67 



11.18 
17.99 



2.66 
4.13 
6.90 



4.03 
6.38 
6.40 



5.06 
3.35 
3.52 



TT7 
2.53 
3.21 



3.77 
6.36 



5.97 
6.88 



7 



m HIGHER 
IITIVE (|U 
TREATHENT II 



CLASS 



N 



21 5 



25 5 



29 5 



27 6 



30 6 



23 5 



26 6 



31 5 



4.22 



2.97 
3.91 



2.74 

5.15 
4.10 



3.08 
6.81 
5,99 



1.58 
1.94 



24 6 



32 6 



28 



22 6 



12.00 
14.40 
13.75 



9.40 
13.20 
12.25 



8.50 
14.00 
11.83 



mo 

15.83 
16.83 



11.6/ 
18.00 
17.83 



13.40 
11.67 



Tu7f7 
17.50 
17.17 



16.80 
17.80 



9.50 
15.17 



11.50 
16.50 
15.00 



11.80 
16.67 

17.001 



11.00 
15.50 
13.00 



10.89 
15.58 



COGNITIVE QUESTIONS COGNITIVE QUESTIONS 



m HIGHER 
IITIVE QUE 
TREATMENT II 



SD 



4.95 
2.41 



2.88 
4.15 
5.56 



3.56 
5.29 
5.78 



2.49 
5.56' 
6.01 



71! 
5.83 
_5.4| 

5.18 



AM 
5.58 
5.12 



7737 

4.71 
2.95 



2.74 
5.49 



2.35 
3.02 



2.68 
5.12 
5.37 



2.76 
3.27 
3.67 



.21 
.58 



lASS 



22 6 



31 6 



30 6 



21 6 



24 6 



29 5 



25 6 



32 6 



23 



26 



27 



28 



X 



13.67 
19.67 



SD 



4.32 
6.47 



12.17 
17,83 
17.50 



10.33 
20,00 
18.83 



9.17 
16.67 
13.33 



19.33 
16.83 



lU.BJ 

15.60 
14.50 



T07 

18.33 
16.83 



20.00 
18.50 



12.60 
15.40 



11.00 
15.67 
lill 



10.67 
14.17 
16.17 



9,33 
11.33 
8.50 



11.32 
17.00 



4.07 
5.04 
5:24 



4.27 
6.90 
7.19 



2.86 
4.93 
5.47 



3.88 
4.62 



2.61 
3.39 



3.72 
4.54 



717 

1.79 
2.43 



5.22 
5.98 



3.35 
6.12 



3.72 
5.08 
5Ji 



2.88 
4.37 
1.73 



1.38 
2.69 



ART ACTIVITY 
TREAT^^EflT II 



27 



26 



23 



3 13.00 
17.09 
4 16.29 



28 



8 



29 13 



24 



32 



8 



25 



12 



30 



9 



3] 11 



22 



21 



11.27 
14.36 



10.20 
14.93 
12.53 



11.00 
13.00 
13.13 



m 

15.08 



14.57 
14,23 



JW 
15.44 
15.13 



TO 

17.25 
1017.10 



7.82 
12.69 

mm 



9.89 
14.91 



11.64 
15.80 
14.D0 



9.73 
12.80 
11.69 



10.83 
14.82 



SD 



3.35 
5.28 



3.76 
5.02 
5.18 



3.06 
5.13 
5.76 



3.32 
5.41 
5.17 



J. IB 
5.25 
4,95 



117 
6.78 
6.96 



7M 
5.01 
3.87 



3.68 
4.71 

i.Ji 



2.?6 
5.4;; 



. // 

E 37 



3.37 
4.28 
4.29 



1.32 
1.50 



Ecology Information Test (Intentional Scale II) 
Study II Descriptive Statistics 



ECOLOGY 
TEACHER 


ISl HIGHER 

COGNITIVE Questions 

TREATHENT II 


501S HIGHER 
COGNITIVE qOESTIONS 
TREATHENT II 


n HIGHER 
COGNITIVE qUESTIONS 
TREATHENT II 


ART ACTIVITY 
TREATHEHT II 


ID 


N 


I 


SD 


CLASS 

N 


I 


so 


ILASb 

N 


I 


SD 


It 


J 


SD 


1 PRE 
POST 


6 

7ft r 
6 

6 


3.33 
6.83 
/,!/ 


1.03 
0.75 
0,75 


5 

21 5 


3.60 
5.40 
5.50 


2.30 
0.89 
1.00 


6 

2^ 6 
5 


3.50 
6.83 
6.40 


1.38 
1.17 

]M 


„1I 


3 55 
5.27 
.,5J 


1.13 
1.19 
l.fi? 


2 PRE 
POST 
.DELAY 


6 

U 6 
6 


4.00 
6.00 
6.17 


1.26 
1.10 
2.14 


5 

2b 5 
4 


3.00 
5.40 
5.25 


1.41 
2.19 

P,96 


6 

31 6 


4.00 
6.83 
5,17 


0.63 
1.17 
1.72 


15 

9C IF 

26 15 
15 


3.47 
5.60 
4.87 


1.41 
1.96 
2.00 


3 PRE 
POST 
DELAY 


6 
6 
4 


2.67 
5.67 


1.63 
2.16 
1.73 


6 

OA 

29 5 


3.17 
00 


1.17 
2.45 
1,50 


6 

30 6 
6 


4.00 
6.83 
5.52 


1.41 
1.47 

ML 


13 

23 11 
14 


3.85 
5.91 
5.21 


0.55 
1.04 
1.58 


4 PRE 

POST 
DELAY 


6 

22 6 
6 


4.50 
7.00 
7.33 


1.38 
1.10 
1.21 


5 

27 6 
6 


3.60 

AA 

6.00 

5.83 


0.89 
1.55 
2.14 


6 

21 6 
6 


2.50 

" rA 

\50 
5.33 


1.22 

1 AA 

1.98 
3.20 


9 

OA A 

28 9 
8 


4.11 
4.67 
4.75 


1.37 

1 10 

1.73 
2.05 


5 PRE 
POST 
DELAY- 


6 

Li 6 
6 


4.00 
5.50 
6.17 


0.63 

A rr 

0.55 
1.33 


6 

' OA C 

30 6 
6 


3.50 

t CA 

6.50 
5.67 


1.54 

1.64 
1.97 


6 

24 6 
6 


3.83 

5.83 
6.17 


0.98 

n /1 1 

0.41 
0.98 


13 

on 10 
29 13 

14 


3.38 

C 00 

5.38 
5.00 


0.96 

1.71 , 
1.92 


6 PRt 
POST 
DELAY' 


5 

30 5 
6 


4.U 
7.40 
5.67 


1.47 

A rr 

0.55 
2.42 


5 

00 c 

23 0 
6 


3.4U 

k on 

4.80 
4.17 


'^'\\ 

1 AO 

1.92 
2.32 


6 

on t 
29 5 

6 


U\ 
6.60 
6.17 


1.21 

n on 
0.89 

1.17 


13 

0/1 1 /I 

24 14 
13 


4.08 

/I no 

4.62 


1.19 

1 ct 

1.64 
1.56 


7 PRE 
POST 
DELAY 


■■ 6 
31 5 
5 


3.00 
6.20 
5.80 


1.57 

2.1/ 
2.05 


6 

26 6 
6 


3.33 

c no 

0.83 
6.50 


1.37 

1 cn 

I.dO 
1.87 


6 

25 6 
6 


3.U 

C TA 

6.50 
6.50 


0.75 

1 nc 

1.52 


9 

00 A 

32 9 
8 


4.33 

C CI 

5.0/ 
5.63 


1.41 

0 10 

2.26 


8 PRE 
POST 
■ DELAY 


5 

2b D 
6 


3.00 

6.00 

6.33 


0.59 

f\ AT 

2.97 
2.25 


6 

31 5 
5 


J.I/ 
6.20 
6.00 


U.o4 
0.71 


6 

00 c 

32 6 
6 


3.50 

C CI 

6.67 
6.83 


].U 

1.21 
1.47 


' 13 

OF 10 

25 12 
10 


3.69 

C 00 

5.50 


1.44 

1 70 

1.35 


9 POST 
DELAY 


29 6 
5 


3.50 

6.67 
5.20 


1.03 
2.39 


24 6 
6 


3.50 
6.33 
4.17 


l.ifi 

1.63 
2.48 


23 5 
6 


3.40 

p 

5.20 
4.00 


1.82 
2.77 
2.10 


'll 

OA 10 

30 13 
12 


3.00 

H AO 

4.92 
3.75 


1.61 

1 r 1 

1.61 
1.71 


PRE 

10 POST 
DELAY 


6 

25 5 
4 


3.1)0 
6.00 
5 50 


0.84 
0.71 
1 Ql 


6 

32 6 


5.00 
5.83 
5 33 


0.63 
0.98 
1 37 

i ■ J/ 


6 

26 6 


3.67 
6.33 
5 67 


1.75 
1.37 
2 50 


9 

31 11 
9 


2,22 
4.73 
4 67 


I.2U 
2.33 
2 18 


PRE 

n POST 

DELAY 


5' 

21 6 
6 


3.17 
6.33 
6.00 


1.63 
1.41 


5 

.28 6 
6 


4.00 
5.83 
5.50 


1.41 
2.14 
2.51 


'6' 

27 6 

6 


3.33 
5.67 
6.17 


1.37 
1.75 
1.47 


14 

22 15 
14 


3.64 

5.33 
4.14 


1.39 
1.68 
2.77 


FKt 

15 DflCT 

DELAY 


— T 

2/ 6 
6 


4.17 
5.67 
5.50 


1.17 
1.86 
2.26 


6 

22 6 
5 


3.83 
6.17 
5.20 


1.72 
1.17 

3.27 


6 

28 6 
4 


3.67 
4.67 
3.50 


1.75 
1.37 
1.73 


15 

21 15 
13 


3.13 
4.73 
4.23 


1.30 
1.58 
1.92 


TREATHENT PRE 
POST 

EFFECT DELAY 




3.58 
6.27 
6.11 


.58 
.59 
.65 




5.94, 

, m 


.j3 
.55 

.57' 




3.57 
6.28 

5.78 

1 


.47 
.72 

1.03 




3.53 
5.25 

4.7/1 


.57 
.46 



TABLE E-4 

Ecology Information Test ,(251! Intentional Scale) 
Study II Descriptive Statistics 



ECOLOGY 



10 



PRE 
P03T 

.m 



PRE 

POST 

DELAY 

ir 

POST 
DELAY 



PRE 

POST 

DELAY 

ir~ 

POST 
DELAY 



PRE 

POST 

DELAY' 



PRE 

POST 

DELAY 



PRE 

'POST 

DELAY 



PRE 

POST 

DELAY 



35i 



10 



11 



12 



TrT 

POST 
DELAY 
PRE 
POST 
DELAY 
IT" 
POST 
DELAY 



ERIC 



TREATMENT PRE 
POST 



2% HIGHER 
COGNITIVE QOESTIONS 
TREATMENT II 



28 



32 



24 



22 



23 6 



30 



31 



26 



29 



25 5 



21 



21 5 



2.33 
3.83 
HI 



2.50 
4.50 
3.67 



3.00 
4.00 
4.75 



4.17 
5.67 
5.50 



2.67 
5.00 
4.67 



3.83 
5.40 
5.00 



2.50 
4.60 
4.00 



2.83 
4.33 
4.17 



1.50 
3.50 
3.80 



T5ir 
4.80 
5.00 
T¥ 
4.83 
4.17 
2.67 
4.83 
4.67 

2.75 
4.61 



SD 



1.51 
0.98 



1.38 
1.38 
2.34 



no 

2.10 
2.50 



50t HIGHER 
IITIVE QOE 
TREATMENT II 



COGNITIVE QOESTIONS COGNITIVE QUESTIONS 



cUsT 



21 



25 5 



1.47 
0.82 
1.22 
BT 
1.79 
1.21 



1.72 
1.34 
2.10 



1.22 
0.89 
1.87 



1.33 
1.75 
1.72 



1.22 
1.79 



TIT 

1.79 
1.82 
1.38 
0.98 
1.47 

Tir 

2.14 
1.86 

0.69 
0.63 



29 5 



27 6 



30 6 



23 5 



26 6 



31 5 



24 



32 6 



28 6 



22 6 



3.40 
3.40 



3.00 
2.40 
2.75 



2.50 
3.40 
2.83 



2.20 
3.50 
3.83 



2.83 
4.00 

4.83 



2.20 
3.60 
ML 



2.33 
3.83 
4.33 



3.17 
4.20 
4.80 



2.00 
3.67 
3.17 



4.50 
.4.17 
2.80 
3.83 
3.83 
2.00 
3.33 
3.60 

2.60 
3.64 



SD 



casT 



1.67 
1.14 
121 



0.71 
1.82 
3.10 



ToF 

1.67 
1.83 



7531 HIGHER 
ITIVE QUE 
TREATMENT II 



22 6 



31 6 



1.38 
1.47 
TT7 
2.37 



0.84 
1.14 
1.03 



1.63 
1.94 
1.37 



0.98 
1.9i 



1.79 
2.06 
2.32 
TTb 
1.64 
1.60 
0.84 
1.33 
1.60 
0.00 
1.97 

i£ 

0.46 
0.52 



30 6 



21 6 



24 6 



29 5 



25 



32 



23 5 



26 



27 6 



28 



3.33 
4.17 



2.67 
3.67 
3.50 



131 
4.50 
4.83 



2.33 
3.67 
3.00 



Ul 
5.17 



2.67 
3.20 
3.50 



117 
3.83 
3.83 



3.83 
5.50 
5.00 



3.80 
3.50 



3.33 
4.17 
4.00 
2.83 
3.33 
3.33 
2.00 
2.33 
_K25. 

2.81 
3.94 



SO 



1.21 
2.40 



2.16 
1.75 
1.37 



T17 

2.43 
1.83 



T17 

1.21 
0.63 



1.33 



0.52 
1.30 
1.87 



0.41 
1.17 
0.75 



1.17 
0.84 
0.89 



1.10 
1.05 



1.03 
2.48 
2.19 
1.47 
1.86 
1.75 
1.10 
0.82 
0.96 

0.52 
0.85 



ART ACTIVITY 
TREATMENT II 



11 



11 
11 



25 



15 
15 
15 



13 

23 11 
14 



28 9 



29 



17 



24 14 
13 



32 



25 



30 1 



12 



31 11 



22 



21 



14 
15 
J4 
15 
15 
13 



3.55 
3.64 
3.64 



2.40 
3.07 
2.53 



TTF 

4.00 
3.79 



7S 
3.89 
3.50 



2.77 
3.31 

3.50 



2.69 
4.14 
4.23 



2.89 
3.78 
3.50 



2.85 
4.25 
4.40 



7718 
2.85 
2.67 



2.56 
4.09 
4.33 
3.00 
4.07 
3.93 
"217 
2.93 
3.08 

2.75 
3.66 



SD 



1.44 
1.96 
1.57 



1.45 
1.67 
1.81 



1.67 
1.53 



T24" 
1.45 
1.20 



TF 
1.65 

1.22 



1.03 
1.23 
1.59 



1.17 
1.99 
1.93 



0.90 
2.05 
2.07 



1.41 
1.56 



1.13 
1.38 
1.32 
1.47 
1.71 
2.13 
HT 
1.67 
1.50 

0.3? 
0.50 



Ecology Information Test (Incidental Scale II) 
Study II Descriptive Statistics 



ECOLOGY 
TEACHER 


25« HIGHER 
COGNITIVE QUESTIONS 
TREATMENT II 


5031 HIGHER 
COGNITIVE QUESTIONS 
TREATMENT II 


75? HIGHER 
COGNITIVE QUESTIONS 
TREATMENT II 


ART ACTIVITY 
TREATMENT II ,. 


10 , , 




J 


SO 


N 


I 


SD 


ILAjo 

N 


I 


SD 


N 


I 


SD 


1 PRE 
POST 
OaAY 


■'' 6 
6 


4.50 
4.50 


0. 84 

1 "31 

1. ^l 

1.87 


5 

PI c 


( 20 
4.50 


1.92 
1.14 

l,/3 


6 

9? c 

? 


5.67 


2.16 

0 oo 

2.88 


11 

97 n 
I] 


3.82 
4.45 

m 


1.72 

0 r h 

2.54 
2.28 


2 PRE 
. . POST 
DELAY 


6 
6 


3.83 
t).b/ 
5.17 


1.72 

1.00 

2.71 


5 


3.00 
4.60 
3.50 


1.58 

1 00 

2.52 


6 
6 


4.33 

C 1 7 

0.17 
6.50 


1.63 

0 00 

2.32 
2.17 


15 

" 15 
15 


3.67 
5.27 
4.33 


1.63 

0 01 

2.31 
1.91 


3 PRE 

POST 
DELAY 


6 


3.83 
4.83 
5.50 


2.64 
2.64 
2.08 


6 

" 5 
6 


2.83 
4.20 
3.33 


1.72 
1.92 
2.25 


30 \ 
JU 5 

fi 


3.33 
7.17 
6.50 


2.34 
2.79 
3.32 


. 13 
23 11 

14 


5.46 
6.00 
6,36 


1.61 
2.86 
. 2.84 


4 PRE 
POST 
DELAY 


6 

u 6 
6 


5.67 
7.67 
7.50 


2.16 
1.97 
2.34 


5 

97 r 

£/ 6 
6 


4.80 
5.00 
5,?3 


0.84 
2.45 


6 

5 


3.33 
5.67 

4.50 


1.37 
2.42 
2.5? 


C 

^0 C 

„8 


3.89 
3.89 
4.13 


1.54 
■2.42 

2,53 


5 PRE 
POST 

DELAY' 


6 

Li b 
6 


5.33 
6.50 
7.00 


1.50 
1.22 
1.55 


6 


4.33 
6.33 

,5.1/ 


2.25 
1.97 

2-54 


6 

<;4 6 

5, 


4.00 
5.83 

,5.,!)0, 


2.28 
1.94 
Ul 


13 

" 13 

14 


3.85 
5.62 
,4.64 


2.19 
2.53 
.2.50 


6 • PRE 
POST 
DELAY' 


6 
6 


3.83 
6.20 


2.32 
2.05 
2,14 


5 

to 5 
6 


6.40 

Jt AA 

4.00 
3,8? 


2.07 

0 AA 

2.00 
1.47 


6 

Ofl c 

29 5 
6 


3.17 
5.00 
3.83 


0.98 

0 AA 

2.00 
2.71 


13 
13 


4.46 

h AO 

4.93 
4.69 


1.71 

0 A^" 

2.06 
2.36 


7 PRE 
POST 
DEIAY 


6 

n r 

31 5 
5 


3.50 
6.40 

_yo 


1.38 

0 tsts 

2.88 

2,39 


6 

<o 6 
6 


4.33 

r PA 

5.50 
5.00 


2.25 

fx %*\ 

2.43 
2.53 


6 

oc C 

a 6 
6 


5.50 

t FA 

6.50 
5.33 


.2.26 
1.97 
2.88 


q 

OO A 

32 9 
8 


3.67 

t* AA 

5.00 
5.00 


1.87 
2.96 
3.02 


8 PRE 
POST 
' DELAY 


6 
0 

r 

0 


4.17 
6.50 
5.17 


1.17 
2.1/ 
2.67 


6 

01 5 

5 


4.17 

C OA 

5.20 
5.60 


1.67 
I./9 
1.67 


6 

10 c 

32 b 
6 


4.67 

7.00 

6.00 


1.2] 
1.41 


13 

oc 10 

25 12 
10 


4.3fi 

c nn 
b.UU 

6.10 


1.71 
l.ol 
' 1.37 


PRE 

9 POST 
DELAY 


■ 5" 

on c 
29 D 

5 


4.33 
5.00 


L.U 
2.50 
2.74 


— 5 

24 D 
6 


3.50 
4.00 
2.83 


i.y/ 

0 1C 

2.1b 
1.72 


~r 

23 1) 
6 


b.Ou 

c on 
b.iiU 

4.83 


I.B/ 
0 oc 

2.48 


"Tl 

on 1 0 

30 13 
.12 


2.18 

^ 01 
4.60 

3.75 


Ul 

1.00 

1.86 


PRE 

10 POST 
DELAY 


5 

25 5 


3.33 

:-6.60 

J.9U 


1.53' 

1.34 
? fiQ 


- fi 

32 6 

f; 


3.1" 

5.17 

i fi7 


■t:33' 

1.60 


■ S 

26 6 
g 


3.50 

4.50 
4 (57 

*t. U/ 


1.22 

2.26 
9 34 


— ^ 

31 11 
q 


4.33 
5.45 
4 67 

T 1 U/ 


1.58 
1.69 
1.73 


PRE' 

n POST 

DELAY 


6 

21 6 
6 


5.33 
6.17 


l.lo 

2.06 
1.47 


5 

.28 6 
6 


4.40 
6.50 
7.00 


().55 
1.87 
1.79 


i 

11 6 
6 


3.S? 

4.67 
5.67 


2.3o 

2.88 
2.66 


14 

22 15 
14 


4.U 

5.53 
5.14 


1.§2 

2.70 
2.66 


PRE 

1 0 DHCT 

1 ^ rUb 1 

DELAY 


~T 

27 6 
6 


4.33 

5.67 
6.50 


1.37 

3.14 
2.07 


22 6 
5 


l.§3 
5.50 
3.80 


1.47 
1.64 
1.30 


28 6 
4 


3.17 
4.00 
3.50 


1.33 
2.37 
0.58 


15 

21 15 
13 


•4.27 
4.00 


1.22 
2.02 
1.63 


TREATMENT PRE 
'■ POST 
EFFECT DELAY 




4.20 
5.86 

m 


0.69 
0.96 

0.81 




4.16 
5.08 

4,67, 


0.98 
0.79 
1.28 




4.19 

5.74' 

5.24 


1.04 
1.08 
1.04 




3.96 
5.05 

4.73 


0.76 
0.71 

0,82 



TABLE E-6 

Oral Test (Content Scale) 
Study II Descriptive Statistics 



ECOLOGT 
TEACHER 


25% HIGHER 
COGNITIVE QUESTIONS 
TREATMENT II 


50% HIGHER 
COGNITIVE QUESTIONS 
TREATMENT II 


75% HIGHER 
COGNITIVE QUESTIONS 
TREATMENT II 


ART ACTIVITY 
TREATMENT II , 


ID 


CLASS 

N 


J 


SD 


CLASS 

N 


J 


SD 


CLASS 
N 


I 


SD 


CLASS 

N 


I 


SD 


1 nnr 

1 PRE 
pn<;T 


28 I 


7.50 
9.17 


3.13 
1.63 


21 I 


8.33 
10.10 


4.26 
3.17 


22 I 


9.92 
8.67 


2.62 
2.42 


27 

11 


8.04 
8.18 


2.34 
4.11 


0 rKt 

POST 


32 I 


4.12 
3 CO 


2.78 
2.41 

bill 


25 5 

6 


5.10 
8.08 


2.63 
2.67 


31 ^ 
^' 6 


2.25 
7.67 


3.86 
3.39 


r 

25 1] 


3.85 
7.73 


3.62 
1.88 


^ rKt 
POST 


2< 5 

J 


6,42 
8 70 


2.67 
3 17 


5 

29 


5.20 
9.80 


2.97 
1.20 


30 1 


5.50 
9.33 


2.26 
1.99 


23 13 


8.^5 
8.58 


""2.29 
2.51 


A PKL 
POST 




7.58 

8 90 


1.83 
1 64 


27 ' 
6 


7.42 
9.17 


2.67 
2.34 




7.08 
9.17 


2.20 
2.91 


c 

28 ; 


7.39 
8.57 


2.79 
2.74 


DDC 

POST 


23 « 


6.83 
8,50 


2.94 
1.79 


30 I 


7.83 
10.17 


2.96 
4.37 


24 6 


4.67 
7.83 


1.78 
2.09 


2S1S 


5.00 
6.92 


2.9l 
2.87 


^ POST 


30 5 


6 00 


2.57 
3 35 


23 \ 


7.33 
10.40 


4,69' 
3.49 




,5.83 
8.70 


2.14 
2.93 


2^11 


6.42 
7.61 


2.2fi 
2.03 


DDC 
^ rKt 

' POST 


3' 2 


5.36 
10.42 


4.37 
1.74 


26 6 


5.40 
8.92 


2.88 
2.33 


25 I 


5.00 
9.17 


2.55 
1.21 


32 I 


5.86 
7,78 


3.66 
1.46 


^ POST 


2« 6 


0.70 
8.50 


0.67 
3.03 


31 n 


7.00 
8.40 


2.47 
1.95 


32 5 


4.90 
10.30 


2.27 
1.04 


25 „ 


4.12 
7.18 


3.26 
2.67 


Q PR^ 

^ POST 




4.67 
7.75 


2.96 
3.71 




5.25 
7.25 


3.31 
4.30 


23 1 


7.38 
8.00 


5.20 
6.89 


30 I 


5.17 
5.17 


2.61 
2.23 


10 

POST 




5.4C- 
10.92 


•5.28 
4.38 


32 I 


5.80 
9.75 


2.66 
2.02 


25 1 


2.58 

7,92 


2.13 
2.90 


31 ] 


4.10 
6,83 


3.04 
2.22 


11 

" POST 


2' 2 


8.62 
8.90 


3.61 
2,01 


28 6 


7.17 
7.75 


2.68 
2.68 


« 5 


7.60 
5.33 


3.16 
2.99 


n \ 


7.75 
7.07 


1.91 
2.18 


12 

POST 




7.50 
9.08 


2.59 
1,86 


22 S 


J.33 
12.50 


13.29 
14.05 


28 6 


7.17 
7.67 


2.16 
1.44 


21 


6.57 
6.57 


3.97 

2,97 


TREATMENT PRE 
, EFFECT POST 




5.85 
8.78 


2.11 
1.22 




6.56 
9.02 


1.14 
1.04 




5.82 
8.31 


2.18 
1.24 




6.08 
7.34 


1.67 
.95 



TABLE, E-7 

Oral Test (Logical Extension Scale) 
Study II Descriptive Statistics 



ECOLOGY 


25% HIGHER 
COGNITIVE QUESTIONS 
TREATMENT II . . 


50^ HIGHER 
COGNITIVE QUESTIONS 
TREATMENT II 


1 

m HIGHER 
COGNITIVE QUESTIONS 
TREATMENT II 


ART ACTIVr 
TREATMENT 


ry 

II 


in 


N 


x 


SD 


N 


I 


SD 


N 


J 


SD 


N 


T 


SD 


1 PRE 
POST 




^ 17 


LiU/ 

m 


f. 

21 


J.UU 

4.10 


9 n? 
2.45 


22 I 


2 17 
3,20 


nr 

1,52 


11 

n 


III 


1.54 

0 nn 

2,85 


2 PRE 
POST 


32 I 


2.9P 


1.5? 


25 4 
" 6 


1 9(; 


2.63 


9 


L/D 

1.50 


9 i7 

1.73 


0 


1 fil 

1 lOl 

3.12 


1.69 
2.26 


3 

POST 


- 2 


370 


1.30 

M4 


29 ; 


1 % 

4,50 


n Q7 
u.o/ 

2,19 


c 

30 

? 


1 .JJ 

3,33, 


1 d7 
1 .f/ 

1.33 


23 

"j3 


OiOl 

2.96 


1.68 
2.07 


4 PRE 
POST 




L\l 

2,90 


O./b 

0,42 


27 ; 






c 

21 

_i 


3.00 


1 C9 


^' 0 


0* 1 1 

5.75 


2.75 
3.57 


pn^T 


23 ' 


0 no 

3.75 


l.bb 

2.49 


30 

,. i 


yi no 

4.50 


2.76, 


24 ^ 
6 


1 7n 

2,55 


1 in 

0,9/ 




?,42 


2.37 

„2J. 


6 PRE 

POST 


r 

30 

5 


1.83 

2,60 


1.94 

3,43 


r 

23 


2,40 

„ 3,60 


2.2(2 

3.56 


r 

29 


1 C"? 

1.0/ 

4,20 


2.05. 


24 

14 


1 cn 

2,11 


1.26 

1,51, 


7 PRE 

POST 


31 

6 


2.50 


1.32 
1.77 




nil 

2.13 

5.25 


1 or 

1.25 
4.99 


25 

" 6 


on 

2.17 

3.08 


1.76 

2,57 


p 

32 ; 


£.9U 

3.56 


1.29 
1,72 


8 PRE 

POST 


b 


No 

/I cn 


Data 
J.Ob 




2.25 
1 fin 


1.44 


32 3 


3.50 
A 7n 


1.00 




1.83 
9 on 


1.25 
.2.18 


Q PRE 

pnsT 


29 ^ 
5 


1.50 
2.90 


1.73 
1.29 


24 I 
„..i 


2.17 
2.92 


2.88 
2.89 


23 ^ 
" 5 


7.33 
5.50 


4.04 
7.84 


30 11 
12 


1.82 
1.04 


1.76 
lil6- 


10 PRE 

POST 


25 ^ 


1.00 
5.25 


1.00 
1.97 


32 I 


3.50 
3.58 


0.50 
2.18 


»i 


0.88 
3.75 


0.85 
1.44 


31 ^ 


1.14 
2.25 


1.49 
1.98 


,y PRE 
" POST 




2.00 
4.90 


1.22 
1.56 


28 J 


2.92 
4.00 


2.08 
1.90 


27 ^ 
5. 


2.17 
?.fiO 


1.60 
?.?2 


22 1^ 
15 


3.00 
3.. 17 


1.64 
1.80 


12 PRE 


11 I 

— 0 


2.42 

,lfi/ 


2.71 
?.ll 


22 6 


2.25 
, 3.33 


0.88 
2.16 


28 I 


1.50 
1.58 


1.41 
1.24 


21 14 
^' 13 


2.29 
2.96 


2.30 
3.22 


PRC 

TREATMENT t 
EFFECT ^ 




2.12 
3.81 


0.56 
0.87 




2.43 
3.93 


0.83 
0.93 




2.35 
3.17 


1.69 
1.09 




2.29 
2.98 


0. 74 

1. n 



TABLE E-8 

Essay Test (Content Scale) 
Study II Descriptive Statistics 



ElULubi 

TEACHER , 


2St HIGHER 
COGNITIVE QUESTIONS 
TREATMENT II 


50^ HIGHER 
COGNITIVE QUESTIONS 
TREr'lENT II 


75^ HIGHER 
COGNITIVE QUESTIONS 
TREATMENT II 


ART ACTIVITY 
TREATMENT II . 


ID 


CLASS 

N 


f 


SD 


CLASS 

rl 


x 


SD 


CLASS 

M 


J 


SD 


CLASS 

N 

11 


)( 


SD 


1 PRE 


28 ^ 


9.92 

ll.OS 


3.29 
2.65 


21 I 


10.20 

n.sQ, 


3.85 

1 r A 

1 l.fi4 


22 ^ 
6 


12.33 

1/1 17 


3.89 


27 '2 

\C 


10.37 
ILiiL 


3.14 

Ot/Q 


■" , PRE 
^ POST 


32 c 
6 


8.58 
11.83 


3.41 
4.46 


6 


10.58 
12.17 


3.15 
4.43 


0 


11.33 

1 1 oc 
11.^3 


4.20 
4.12,, 


26 11 


9.70 


4.15 


. PRE 
^ POST 


6 


11.67 
15.67 


6.01 
7.46 


29 [ 
5 


8.25 
8.60 


3.27 
4.02 


30 I 


11.92 
11,6/ 


3.62 


AO 13 

Li 

13 


14.54 


5.21 


PRE 

^ PO.ST 


22 [ 


11.25 
12.50 


2.32 
2.57 


6 


10.08 
11.42 


4.62 

A ^ r 

?,i5. 


21 I 


9.20 
10,58 


1.89 
2.24. 


28 I 


8.83 

1 1 11 


5.29 


, PRE 
^ POST 


23 ^ 


12.75 

13.3? 


3.93 

5,17 


30 I 


12.67 
12.50 


3.66 
2,68. 


24 I 


11.00 
14.25 


1.95 
3.72 


29 1^ 
._14 


9.75 
9. ,6,1 


2.81 


^ 'POST 


30 ^ 


12.08 
12.20 


2.27 
1.56 


23 ^ 
" 5 


14.42 
15,10 


.5.94 
3,/l, 


29 I 
5 


8.58 

A A A 


2.50 

/I 01 

4.21 


24 " 
13 


9.39 

1 0 AO 

13i.0L 


2.61 
-i2i 


7 PRE 
' POST 


31 ^ 
^' 6 


8.42 
11.83 


3.72 
4.82 


« I 


9.50 
1().17 


2.68 
3,/0 


25 ^ 
" 6 


11.83 
13.25 


1.63 
2.30 


32 


9.61 
10.00. 


1.93 
3.01 


ft PRE 
POST 




in '3Q 

8.17 


5.11 




13.92 


5,42 


c 

32 


0.00 

12.00 


L .L J 

3.07 


«r 1? 

13 


12 83 
11.27 


5 34 
4.69 


PRE 

^ POST 




9.92 
9.17 


2.56 
1.5/ 




9.42 
14.00 


4.77 
6.24 


«s 


10.75 
11.50 


5.02 
10.75 


30 

^ 13 


9.35 
fi..l5 


3.70 
3.5? 


10 • 

POST 




8.92 
13.0(1 


5.51 
3.81 


32 5 


10.60 
.13.50 


1.47 
2.80 




8.17 
11.75 


2.56 

?,?7 


31 ^ 

n 


9.83 

m? 


5.00 
4.30 


11 

' ' POST 




10.75 
10.50 


3.57 
3.59 


28 I 


10.25 

12;33 


3.83 
2,27 




10.00 
10.92 


2.24 
3.65 


22 1^ 
^ 15 


10,57 
ll.OJ. 


2.27 


12 

POST 


27 ' 
6 


10.42 
9.67 


5.45 
4.74 


22 ; 


10.50 
1S.08 


3.83 
3,95 


a I 


7.00 
9.40 


3.72 
4.22 


21 15 
15 


9.30 
18.13, 


4.68 
3.60 


TREATMENT PRE 
.EFFECT POST 




10.41 
11.58 


1.37 
2.04 




10.75 
12.54 


1.68 
1.93 




10.08 
11.64 


1.71 
1.64 




10.34 
10.35 


1.67 
1.78, 



lABLt t-y 

Essay Test (Logical Extension Scale) 
Study II Descriptive Statistics 



t 

ECOLOGY 
, TEACHER 


25% HIGHER 
COGNITIVE QUESTIONS 
TREATMENT II 


50% HIGHER 
COGNITIVE QUESTIONS 
TREATMENT II 


75% HIGHER 
COGNITIVE QUESTIONS 
TREATMENT II 


ART ACTIVITY ' 
TREATME^fT II , 


ID 


CLASS 

N 


x 


SD 


lASS 

N 


)( 


SD 


CLASS 
N 


V 

A 


cn 


CLASS 

N 


v" 

A 


cn 


[ PRE 
POST 


00 6 
CO r 

6 


1.17 
1.33 


0.75 
1.44 


?l 5 
2' 5 


1.10 
1.50 


0.65 
0.50 


00 6 

6 


1.67 
2.75 


1.63 
2.60 


27 12 


2.67 
3.08 


2.73 
1.99 


P PRE 
POST 


00 6 

6 


2.08 
1.83 


1.83 
1.21 


6 


2.67 
2.00 


2.56 
1.18 


6 


1.67 
1.92 


0.68 
1.56 


26 


1.97 
0.82 


2.11 
1.12 


. PRE 
POST 


0)t 6 

2' 6 


2.17 
4.25 


1.81 
2.88 


2' 5 


0.83 
1.40 


1.03 
1.29 


30 g 


2.25 
1.58 


2.07 
1.80 


23 

13 


4.S5 
3.00 


3.07 
2.28 


4 PRE 

POST 


2^ 6 


1.42 
1.00 


' 58 
J. 95 


" 6 


2.33 
1.92 


1.66 
1.32 




1.20 
1.50 


1.15 
1.48 


9 


1.06 
1.83 


1.38 
1.71 


r PRE 

POST 


00 6 

" 6 


2.42 
2,67 


2.33 
3,14 


on 6 

30 J 


2.33 
1.25 


2.23 
1.17 


''I 


0.92 
2.42 


1.32 
2.35 


on 14 
29 14 


1.50 
.93 


1.81 
.96 


fi PRE 


30 5 


3.00 
1.60 


1.64 
0.82 


00 6 

23 ^ 


3.92 
2.30 


2.89' 
0.91 




1.75 
1.60 


1.37 
0.65 


2^ 13 


1.46 
2.04 


1.84 
2.21 


7 PRE 


nl 6 

3 


1.58 
2.17 


1.36 
2.0^ 


or 6 
6 


2.00 
1.67 


1.45 
1.50 


''I 


2.58 
2.58 


1.96 
2.04 


9 

00 

32 7 


1.67 
1.28 


1.03 
0.76 


8 PRE 


\ 


1.33 
1.17 


0.82 
1.12 


31 1 


4.17 
3.50 


3.1b 
3.22 




1.25 
1.50 


0.69 
1.05 


12 

" 13 


2.79 
1.35 


2.85 
1.59 


, PRE 

POST 




2.75 
0.83 


3.08 
1.21 




1.58 
3.50 


2.44 
3.94 


23 .33 


5.43 
4.00 


— rr 

13 

3» 13 


1.23 
0.88 


"I'TT" 

I.dI 
1.14 


POST 




1.58 
' 3.50 


1.93 
3.74 




1.40 
1.83 


.96 
1.75 




i.OO 
1.67 


1.26 
1.66 


31 ,1 


1.11 
2.18 


]M 

1.79 


11 PRE 
' ' POST 




3.08 
2.70 


3.88 
8.57 




1.83 
4.00 


2.29 
2.97 




1.33 
2.42 


1.72 
3.46 


H 

" 15 


1.43 
1.27 


1.14 
1.44 


12 

POST 




2.67 
2.1/ 


2.64 
4.36 


n I 


1.58 
2.75 


2.01 
2.02 




1.17 

1.10 


1..25 
1.02 


21 

" 15 


2.03 
1.33 


2.00 
1.40 


TREATMENT PRE 
, EFFECT POST 




2.10 
2.10 


0.68 
1.04 




2.14 
2.30 


1.03 
0.92 




1.80 
2.03 


1.08 
0.66 




1.96 
1.66 


1.02 
0.78 



TABLE E-10 



Transfer Test (Content Scale) 
Study II Descriptive Statistics 



Ecology 

:v~-.^EACHER 


25% HIGHER 
COGNITIVE QUESTIONS 
TREATMENT II 


50% HIGHER 
COGNITIVE QUESTIONS 
TREATi^ENT II 


m HIGHER 
COGNITIVE QUESTIONS 
TREATMENT II 


ART ACTIVITY 
TREATMENT II , 


- Id 


CLASS 

N 


J 


SD 


;lass 

N 


X 


SD 


CLASS 
N 


I 


SD 


CLASS 

N 




SD 


1 DELAY 


28 6 


8.08 


^85 


21 4 


8.00 


4.45 


22 5 


8.90 


2.01 


27 12 


8.37 


0 /n 
j.4l 


2 DELAY 


32 6 


8.25 


5.45 


25 5 


10.40 


2.10 


31 6 


8.83 


2.29 


26 15 


6.77 


3.19 


3 DELAY 


24 4 


9.62 


1.89 


29 6 


7.08 


3.46 


30 6 


8.67 


2.38 


1 /I 

23 14 


11.46 


2.89 


1 DELAY 


22 6 


9.17 


3.42 


27 6 


8.67 


3.20 


21 6 


6,92 


3.54 


28 8 


7.69 


4.63 


5 DELAY 


23 6 


14.17 


6.86 


30 6 


10.9L 


4.22 


24 5 


8.17 


1.57 


29 14 


8.00 


4.15 

- 


6 DELAY 


30 6 


8.67 


1.83 


23 6 


9.42 


3.15 


29 5 


7.92 


2.44 


24 13 


8.54 


2.27 


1 DELAY 


31 5 


7.50 


2.77 


26 6 


8.00 


3.08 


25 5 


11.58 


3.29 


32 8 


8.44 


3.75 


8 DELAY 


26 6 


8.08 


3.22 


31 5 


10.10 


4.34 


32 6 


7.25 


4.^3 


25 12 


11.04 


5.63 


9 DELAY 


29 6 


7.75 


3.39 


24 6 


10.58 


4.59 


23 6 


8.58 


8.10 


30 13 


5.15 


3.40 
4.73 


^ DELAY 


25 5 


11.50 


5.88 


32 6 


8.92 


3.25 


26 6 


8.83 


2.56 


3: 10 


9.05 


ll DELAY 


21 5 


6.50 


3.36 


28 6 


8.00 


1.82 


27 5 


9.17 


3.91 


22 14 


m 


1.25! 


DELAY 


27 6 


6.75 


4.80 


22 6 


8.83 


4.01 


28 5 


7.20 


3.82 


21 13 


5.42 


3.71 


pEATMENT DELAY 




8.85 


2.13 




9.07 


1.22 

1 




8.50 


1.23 


— 1 


8.38 


1.63 



Transfer Test (Logical Extension Scale) 
Study n Descriptive Statistics 



ECOLOGy 
TEACHER 



25^ BB 

mmm qoestions 

TREATMENT. II 



TREATMENT 
EFFECT DELAY 



50^ HIGHER 
COGNITIVE QUESTIONS 

TREATiLn 



m HIGHER 
COGNITIVE QUESTIONS 
TREATMENT II 



ART ACTlVin 
TREliTn 
CLASS 




TABLE £-12 

Ouestion-Generating Test, Paper-and-Pencil Measure (toh r of Nonpertinent (juestions) 

Study II Descriptive Statistics 



« 

ECOLOGY 
TFACHER 


25% HIGHER 
COGNITIVt QOESTIO^S 
TREATMENT 11 


501 HIGHER 
COGNITIVE flUESTIONS 
TREATMENT H 


755! HIGHER 
COGNITIVE flUESTTONS 
TREATMENT II 


jivn 

. -ATMENT 1 


■y 

I , 


in 


N 


I j SB 




J 


SD 


CLASS 
N 


J 


SD 


CLASS 

N 


J 


SD 


PRE 




0.42 


O.oo 


21 ; 


1,10 


1 19 

3,5/ 


Art U 

22 I 


0.08 
0,25 


0.20 

0,« 




1.09 

0,32 


1.58 
0,78 


« PRE 
POST 




0.08 
0.05 


A AA 

0.20 
?.2() 


25 

" 5 


1 10 

o./o 


1 95 

1.10 


,1 6 
^1 6 


0.50 
0.08 


0.45 
0.20 


oc 15 
2^ 15 


0.50 
0.23 


0.91 
0.42 


" PRE 

£!SL 




0.42 


A rr 

0.66 
0,52 


29 ° 
5 


n 4? 

U.Tt 


0 49 


6 

30 I 


0.50 
0,9? 


0.55 
2.01 


oo 13 
23 ^2 


0.12 
0.62 


0.30 
0.74 


4 PK 

POST 




0.00 
0.08 


A A A 

0.00 


27 ° 
^' 6 


u. jo 

0.08 


n fin 
0,25 




1 33 


2.56 
3.41 


AA J 

28 9 


0.61 
0.33 


0.82 
0.56 


: PRE 1 


23 J 


0.17 
JIL 


0.26 
. 2.21, 


30 ^ 

b 


UiUO 

0.00 


0,00. 


6 


0 42 

0,75 


1.02 
0,69 


on 14 


0.32 
0.11 


0.50 
0.40 


fi PRE 




G.42 
J.25 


0.58 


23 

b 


U.oo 

1.80 


n C7 

u.o/ 
1.86 


29 ° 
5 


U.Oj 

0,50 


1 fil 

1 .0 1 

0,(57 




0 54 
1.00 


0.66 
1.11 


, PRE 




0.58 


1.02 


26 6 


n 17 
U.i/ 

0.09 


Ui4l 

0.20 




UiOO 

0,92 


1 37 

2,01 


9 

32 ; 


0.56 

0,00 


1.31 
0.00 


fi PRE 

__l__Jiia_ 




1.08 
Mi 

J.40 


1.74 
J.2I 


31 ^ 

0 


1.80 
0.00 


2.71 
0.00 


32 ; 


0.08 
0.00 


0.20 
0,0 




0.31 

0.17 


0.52 


5 PBE 


0.42 
0.55 


A.^ 6 


0.17 
0.75 


0.41 
0.96 


23 ^ 

6 


0.33 


0.60 

o.§« 


30 " 


0.46 
0.12 


0.78 
0,30 




'I 


0.33 
J.]7 


0.41 
0.26 




0.08 
JU2 


0.20 
1,56 


»; 


0.00 
0,50 


O.OC 
0.5C 




0.69 
0.27 


1.58 
0.34 


PRF 

11 


"I 


0.25 
J.17 


0.27 




0.10 
317 


0.22 
0,26 




2.25 

ItOO 


5.27 
1.5E 


22 " 
''^ 15 


0.15 
0.43 


0.43 
0.78 


12 




1.08 
.0.50 


1.2G 
JJI 


6 


0.08 
.0.10 


0.20 

0,22 




0.92 
0,42 


0.97 
0,3? 


21 '5 
15 


0.40 
0.53 


0.83 
0.94 


TREATMENT PRE 
.EFFECT POST 




0.42 
0.37 


0.35 
0.34 


0.50 
0.42 


0.55 
0.54 


— 


0.67 
0.61 


0.6; 
0.44 




0.48 
0.34 


0.26 
0.28 



ERIC 



cn 



Question-Generating Test, Paper-and-Pencil Measure (Number of Pertinent Questions) 

Study II Descriptive Statistics 



tLULUbi 

TEACHER 


2555 HIGHER 
COGNITIVE QUESTIONS 
TREATMENT II 


50^ HIGHER 
COGNITIVE QUESTIONS 
TREATMENT II 


m HIGHER 
COGNITIVE QUESTIONS 
TREATMENT II 


ART ACTIVITY 
TREATMENT II , 


ID 


CLASS 

HI 

N 


I 


SD 


CLASS 


J 


SD 


CLASS 

It 


I 


SD 


CLASS 

N 


I 


SD 


1 PRE 
POST 


0 


13.25 

10 CO 
K.OO 


5.91 


21 I 


12.50 

11 90 
1 1 .lU 


10.83 

0. JJ 


D 


16.92 


5.75" 

7 0^ 


K 


14,09 
M 32 


5.36 

5 72 


5 PRE 
^ POST 


V ^ 

JC r 

D 


10.08 

y.o/ 


3.75 

c /in 


0 


14.40 

l'^ Qfl 


3.56 

? Q7 


3'! 

0 


16,25 

11 71^ 
1 i . / J 


3.71 


26 S 


10.17 
6 90 


5.63 


, PRE 
^ POST 


0 


11.75 
ly.jj 


7.10 

T3 AT 


0 


6.83 
Q nn 


iM 

1 97 

i .l/ 


30 I 


11.00 
1/1 '^n 


4.20 

0>Ji 


23" 

1? 


17 38 


5.60 


4 PRE 
^ POST 


D 


V 83 


4.06 

O./D 


» I 

D 


12.17 

17 ^17 


5.28 

ft W 

0.03 


2'1 


13.25 

lA ft? 


3.09 

ft % 


9 

28 9 


18.33 
n 11 


7.11 

10 1? 


^ POST 


6 


11.58 

H.58 


6.36 
10,11 


b I 

0 


10.83 
y./o 


3.64 

A 17 
4. 1/ 


2^1 


11.58 
ii; c:n 


6.22 
7 Q7 

/ .3/ 


29 

14 


8.64 
04 

0 ♦ U I 


4.35 
4 4fi 


PRE 

° POST 


30 \ 


11.92 

T3 AA 

13.00 


5.50 
3. lb 


23 I 


14.58 

u in 
lb. lU 


7.64" 
in 71 

lU./ i 


29 5 


7.83 
7 on 


3.42 

J. 


14 


13.81 
19 04 


5.82 
9 2? 


' OST 


31 \ 


12.25 
9.50 


5.93 

5,21 




11.00 

O./O 


8.46 

'3 /IQ 


25 6 


11.75 

19 17 


3.33 

0.4j ^ 


9 

32 \ 


10.72 


5.73 

J. CI 


fi PRE 

^ POST 




7.83 
6.42 


2.99 
3.83 




19.70 
12.10 


7.06 
3.13 




9.83 
11.17 


3.59 
4.07 




12,58 
10.71 


6.66 
4.30 


n PRE 

^ POST 




n i? 

1 1 .HL 

9.60 


2.70 


24 ; 


11 08 
23.62 


7.43 
11.43 


6 

23 6 


13.08 
13.33 


7.51 
8.62 


13 
30 13 


10.88 
7.88 


5.90 
3.65 


10 

POST 




11.00 
il.l7 


3.02 
6.45 




13.92 
16.08 


5.00 
6.78 


«5 


7.17 
5.50 


2,71 
2.50 


31 ^ 


14.38 
10.95 


5.69 
3.92 


PRE 
POST 


6 


14,33 
12.08 


8.21 
5.57 


» 6 


11,70 

14,j0 


6.13 
7.13 


"1 


9.58 
9.92 


5.43 
Q.20 


" 15 


16.27 
14.;7 


6.22 
5.95 


POST 


27 ^ 


]l.r: 


5.02 
6.99 


22 I 


15.92 
16.10 


6.33 
6.97 


2«1 


7.25 
9.6/ 


4.55 
4.47 


21 

15 


9.70 
9,60 


3.66 
5.48 


TREATMENT PRE 
. EFFECT POST 




11.96 
12.21 


1.93 
3.41 




12.88 
13.94 


3.18 
4.39 




11.29 
11.74 


3.22 
3.08 




13.13 
11.90 


3.25 
4.Q4| 



TABLE E-14 

(juestion-Generating Test, Paper-and-Pencil Measure (»er of Specific (Juestions) 

Study II Descriptive Statistics 



1 

ECOLOGY 
TEACHER 


25?^ HIGHER 
COGNITIVE QUESTIONS 
TREATMENT II 


50"/ HIGHER 
COGNITIVE QUESTIONS 
TREATMENT II 


75% .HIGHER 
COGNITIVE QUESTIONS 
TREATMENT II 


ART ACTIVITY 
TREATMENT II , 


ID 


N 


I 


SO 


CLASS 

N 


I 


SD 


CLASS 
N 


j( 


SD 


CLASS 

N 


J 


SD ' 


1 PRE 
POST 


28 1 


1 .0/ 

2.1/ 


1.99 


21 I 


2 00 
1,?0 


0 50 

1,?? 


n« 6 

22 

" 6 


4.17 
4.5§ 


2.99 
1,53 


07 11 
2^11 


5.23 
5.73 


3.58 
4.87 


P PRE 
POiT 


32 ° 


2.25 


9 (11 

1.97 


25 

" 5 


d Qfl 

5.80 


? 28 
3.42 


6 

3 

^' 6 


3 25 
5.17 


3.72 
4.06 


or 15 


3.47 
1.93 


4.43 
2.33 


0 PRE 
POST 




9 nn 

c.UU 

5.50 


9 9fi 

4,64 


29 

5 


2.10 


2 24 
2.58 


6 

30 

5 


1.92 
1.00 


2.46 
1.22 


23,2 


2.58 
3.08 


2.35 
2.55 


POST 


It ^ 


9 9(; 
3,42 


9 19 

3.12 


27 


5,92 


a 14 
3.85 


6 

2 

^' 6 


4 17 
3.50 


3 68 
3.27 


28 I 


4.06 
3.89 


2.73 
5.51 


r PRE 

» n ATT 

POST 


r 

23 ° 


4,50 


9 Q/I 

5,27 


30 I 


1 nn 

J.UU 

3.08 


^5 in 
2.62 


24 « 


] 75 
5.08 


3 25 
6.87 


14 


1.39 
1.43 


1.81 
2.02 


r PRE 

POST 


30 J 


j. 1/ 

2.88 


9 QQ 

4.01 


23 ^ 


5.80 


5.73 


29 I 


0 92 
1.70 


0 67 
1.56 


13 


2.35 
3.32 


3.31 
2,58 


7 PRE 
POST 


r 

31 ^ 


0 CO 

2.58 
4.75 


0 /I/I 

3,48 


I 


n nc 
3.08 


2.20 


25 

" 6 


4 nn 

2,00 


1 76 
2.26 


q 

32 I 


1 78 
1.25 


2.53 
1.20 


A Pf^^ 
POST 




2.33 

0 58 


1.54 
0.66 


31 ^ 


4.30 
4.80 


3.60 
4.10 


32 ^ 
" 6 


1.25 
4.17 


1.22 
3.70 


13 
25 j^^ 


4.85 
3.08 


4.01 
2.82 


n PRE 
POST 


29^ 


1.58 

l,/0 


1.28 
1,48 


: 


2.83 
5.38 


2.94 

4,17 


23 ^ 
" 6 


1.58 

IJ 


2.58 

],38 


30 13 


1.62 
1.73 


1,36 
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0.23 



Hord Association Scale (Attitude Toward Ecology) 
Study 11 Descriptive Statistics 



ECOLOGy 
TEACHER 


252 HIGHER 
COGNITIVE (JUESTIONS 
TREATHENT II 


5055 HIGHER 
COGNITIVE (JiJESTIONS 
TREATMENT II 


'■^n HIGHER 
COGNmVE (jUESTIONS 
TREATMEUT II 


ART 

ll\un 


ACTIVIl 
TMFNT 1 


"Y 
I 

i , 


ID 


CLASS 

N 


I 


SD 


CLASS 

N 


I 


SD 


CLASS 
N 


I 


SD 


CLASS 

N 




SD 


] PRE 
POST 


28 J 


58.6? 
68,83 


18.95 


' ! 


57.50 


6.86 
S.17 




58.S3 
66.50 


12.51! 


"1! 


62.00 
66.92 


7.27 
5.27 


PRE 
POST 


32 J 


57.67 
6?, 67 


6.92 
7.20 


% 5 
6 


65.40 

6Snl3 


5.22 

4.18 


31 I 


52.33 


20.27 
1.30 


< 


61.93 
66.57 


8.17 
2iL 


PRF 

^ POST _ 


24 I 


59.50 


8.34 


29 1 


59.83 


6.74 


30 ^ 


61.17 


8.64 


23 i 


2 


61.50 


6.75 

ir rr 


PRE 

^ POST 




59.83 
65.80 


15.16 
8.84 




59.67 
69.00 


9.20 
1.55 




45.80 
59.00 


8.17 
8.62 


28 


9 
9 


55.78 

rr Art 

56.00 


7.74 
14.46 


^ POST 


23 5 


62.40 
65.00 


8.08 
9.03 


30 I 


64.00 
64.17 


6.20 
7.05 


< 


59.00 
63.83 


12.07 
7.30 


29 


55.07 
59.07 


11.28 
12.61 


PRE 

^ POST 


30 « 


63.50 
69.00 


5.09 
1.41 


23 I 


61.17 
65.50 


8.40 
4.04 


29 « 


64.67 
65.40 


7.94 
5.50 


^^14 


61.23 
63.64 


6.72 
9.82 


PRE 

^ POST 




61.00 
60.50 


7.72 
10.29 




60.00 
67.67 


9.74 
3.83 


25 ' 


68.50 
67.83 


1.73 
4.02 


32 


y 

7 


63.78 
69.14 


5.09 

A 01 

2.27 


PRE 

" POST 


»s 


58.83 
56.50 


12.76 
23.53 




51.80 
61.67 


9.63 
12.91 


32 S 


62.17 
69.50 


' 5.56 
1.22 


25 iS 


63.50 
66.54 


6.32 
7.12 


PRE 

^ POST 


2' 6 


53.83 
47.33 


8.42 
21,11 


" 6 


63.33 
56.00 


9.58 
16.40 


23 I 
6 


55.00 
67. 3i 


10.32 

i.li 


30 S 


55.75 

r r AA 

55.92 


10.67 
17.69 


PRE 
POST 




66.20 
66.67 


3.56 
6.06 


32 5 


56.50 
60.80 


14.39 
11.21 


26 S 


57.00 
53.67 


14.83 
22.77 


31 


y 

8 


52.22 
49.38 


■7.48 

11 /I A 

17.48 


•ji PRE 
' ' POST 




53. 5C 
68.20 


8.87 
2.68 




59.17 
66.00 
56.83 


7.98 
3.85 
18.69 


27 S 


-55.67 
61.50 


15.69 
9.09 
11.49 


"14 


58.62 
65.71 


9.12 
6.39 


12 11 




60.67 


11.72 


22J 


28_[ 


63.00 


21 . 


b 


53 73 
64,67 


10 45 
7.77 


WMBI PRE 
EFFECT POST 




59.63 
62.48 


J.64 
6.32 




59.60 
63.01 


3.72 
4.69 




58.59 
64.51 


6.04 
4.76 




58.76 
61.91 


4.O6 
5.94 



Word Association Scale (Attitude Toward Balance of Nature) 
Study II Descriptive Statistics 



1 ' , . , 

ECOLOGY 

TEACHER _ 


25^ HIGHER 
COGNITIVE QUESTIONS 
TREATMENT II 


50? mm 

COGNITIVE QUESTIONS 
TREATMENT II 


75^ HIGHER 
COGNITIVE QUESTIONS 
TREATMEsIT II . 


ART ACTIVITY 
TREATMENT II . 


ID 


cUsi 

N 


X 


SO 


CLASS 

N 


'i 


ID ' 


CLASS 
N 


1 


SD 


CLASS 

N 


if 


SD ! 


1 PRE 
POST 


28 [ 


57.50 


8.38 
IM 




5S.S() 

51.60 


S./O 
3.65 




52.50 

61.17 


2.48 


2,12 
12 


55.83 
59,08 


/.by 
8,63 


P PRE 
POST 


32 I 


58.83 
59,50 


7.68 
3./? 




52.20 
6(1,83 


2.17 
6.11 


31 « 


54.83 
63.60 


15.60 
4.51 


1 r 


57.20 
57.14 


10. bj 
12.13 


^ PRE 

POST 


24 I 


55.50 
Ml 


6.89 

7,23 


29 ' 
5 


58.83 
55.00 


4.45 
6.52 


30 ; 


56.83 
62.83 


7.33 
4.35 


23 1^ 
" 13 


59.42 
57.85 


7.84 
13,86 


L PRE 
POST 




5il7 
51,00 


5.56 

M 


2/ ' 


52.17 
59.00 


8.49 
b.57 




49.80 
58.17 


ft IT 

8.17 
8.47 


A 

28 5 


53.11 
55.33 


0./4 
11.30 


c PRE 
POST 


23 5 


53.80 
57.00 


5.36 
9.57 


30 I 


58.33 
^ 66.50' 


7.06 

4,,46, 


24 ' 


61.00 
63.00 


4.77 
5.40 


29 1^ 
14 


f"/* Art 

56.00 
55.14 


8.49 
13.86 


fi PRE 

^ POST 


30 6 


63.33 
65,29 


5.28 
6.72 


23 I 


51.83 

64,'40 


10.68 
3.65 


29 f 


64.67 
65.00 


6.19 
6.20 


1 A 

24 1^ 

14 


53.92 
56.86 


5.44 
9.00 


1 PRE 
POST 




50.17 
48.1/ 


8.47 
24,35 




53.00 
59.50 


7.48 

m 




59.00 
55.17 


12.25 

7,33 


Q 

32 7 


54.89 
59.96 


9.92 


p PRE 
^ POST 


26 J 


54.00 


7.35 
9.02 




53.60 
54,00 


1100 
11.37 


32^ 


55.57 
62;33 


4.63 
4.89 


25 


56.63 
59.15 


5.95 
9.20 


■ q PRE 
POST 


29 ^ 

fi 


5167 
50.67. 


6.02 

11.84, 


C 


52.50 
49.32 


17.18 

11 Art 


23 § 


57.20 


5.36 

p no 


30 J 


52.83 
54 23 


8.57 
11.81 


in PRE 

10 p'r 




61.60 
fiO.83 


6.99 
7.81 


32 ; 


57.83 
57.60 


5.98 
10.60 




59.17 
60.17 


7.78 
6.27 


! 


50.00 
57.25 


7.30 
11.65 


11 11^ 


2l[ 


51.83 


8.80 


28 I 


56.00 
58.83 


6.90 
5.81 




56.00 
60.67 


8.74 
7.47 


„I3 

14 


55.38 
60.14 
56.73 
57.13 


9.13 
7.85 


12 PI^E 

pn^T 


27 ^ 

fi 


55.17 


10.57 
11.09 




56.83 
63.67 


6.87 
3.92 




58.17 
61.00 


i0.42 
6.63 


" 15 


7.11 
9.00 


TREATMENT PRE 
. EFFECT POST 




55.88 
58.91 


3.83 
, 6.31 




55.72 
59.40 


3.22 
4.60 




57.07 
61.41 


3.86 

m 




55.16 
57.43 


2.45 
1.89 



Word Association Scale (Attitude Toward Woli/es) 
Study. II Descriptive Statistics 



rrni npv 

clULuhi . 

TEACHER 


m HIGHER 
COGNITIVE (lUESTIONS 
TREATMENT II 


50^ HIGHER 
COGNITIVE QUESTIONS 
TREATMENT II 


75^ HIGHER 
COGNITIVE (lOESTIONS 
TREATMENT II 


ART ACTIVn 
TREATMENT 1 


1 

[I . 


ID 


CLASS 

N 




• SO ■ 


CLASS 

hi 
N 


X 


SD ' 


CLASS 


x 


SD 


CLASS 

N 


I 


SD 


1 PRE 
POST 


28 i 


60.6/ 


8.12 
7.37 


21 ! 

0 


51 ,« 

04.cU 


10.36 


22 I 

0 


54.00 
fin 17 

oil. 1 / 


7.32 

7 'i7 


CI 10 

1 L 


56 92 


1 L ( Uu 

9.96 


5 PRE 
^ POST 


32 I 


50.00 
52.50 


8.65 
8.17 


25 I 


44.20 

00.0 J 


7.73 

Q 01 

y.u/ 


J 


46.83 
fil nn 


8.13 

J. to 


26 jj 


52.07 
51 86 


8 25 
14.74 


. PRE 
^ POST 




46.50 
54.33 


9.07 

11.91 


0 


46.53 


3.39 

7 09 


30 S 

0 


47.67 

ou.oo 


4.76 

' fi fi"! 
U lUJ 


23 '2 

" 13 


50.17 
54 38 


6 32 

I3':i8 


. PRE 
^ POST 




53.00 
61.20 


4.47 
7.01 


2? ! 

0 


50.17 
04.00 


12.50 

Q 7Q 

o./o 


2'S 


50.00 

00. 1/ 


4.00 


9 

28 5 


50.11 

50 "ifi 


7 fit) 

7.75 


^ POST 


23 r 


52.60 
58.40 


9.71 
7.64 


30 I 
6 


52.83 
55.67 


8.57 

9.51 


0 


45.67 

33.00 


6.12 

n ni; 

1 1 .U3 


< 


45.14 

OH.jU 


10 83 
11.74 


, PRE 
^ ^ POST 


30 I 


47.17 
61.40 


17.88 
5.64 


23 r 

5 


49.83 
53.40 


8.23' 
10.14 


29 \ 


51.67 

04. uu 


8.26 

"5 ft? 
0.0/ 




44.15 

^i? 14 


10 24 
12.16 


^ PRE 
' POST 


31 ! 


44.50 
■5] -.83 


7J4 
9.87 


26 fi 


51.00 

CO cn 
DO.OU 


5.80 
lU.ol 


25 fi 


61.00 
^^Q nn 

03. UU 


3.46 
fi 11 


32 J 


46.78 
50 71 


12 76 
8.44 


— PRE 

^' POST 


26 ^ 


46.83 
56iO 


7.5.^ 
9.52 


5 

31 r 

6 


46.20 
58.83 


8.61 
9.33 


32 fi 


51.00 
o/.oo 


4.43 
t).ol 


25 iS 

|j 


52.25 


fi Qfi 

9.50 


PRE 

^ POST 




ll.OO 


1334 

]iM 




46.33 
56.83 


5.89 
11.20 




51.40 
55.00 


10.97 
9.76 




47.50 
51.38 


o.to 

11.29, 


POST 




c;i fin 

31 lOU 

63.83 


j.Oj 

6.08 


32 I 


59.00 


9 89 
9.22 


. 6 


51.00 
60.00 


7.59 
10.12 


31 g 


46.33 
46.88 


q Ql 
12.03 


" POST 




47.17 
60.00 


6.91 
11.64 


2« S 


49.17 
54.00 


7.08 
4.03 




59.17 
64.67 


6.08 
5.43 


22 


51.62 
50.14 


11.04 


PRE 
POST 


"I 


56.50 
59.?3 


7.39 
7.17 




46.17 
54.17 


5.34 
9,33 




46.50 
55.?? 


15.48 
11.1? 


15 
2'l5 


50.87 
52.53 


10.84 
10.68 


TREATMENT PRE 
. EFFECT POST 




49.60 
57.58 


3.64 
4.26 




49.03 
55.49 


3.24 
3.73 




50.20 
58.02 


3.80 
4.26 




48.92 
52.31 


2.81 
2.75 



ECOLOGY 
TEACHER 


25X HIGHER 
COGNITIVE (''JESTIONS 
TREATMENT II 


5051 HIGHER 
COGNITIVE OUESTIONS 
TREATHENT II 


75]i HIGHER 
COGNITIVE dUESTIONS 
TREATHENT II 


ART ACTIVn 
TREATHENT ] 


[I , 


ID 


N 




SD 


cLAss 

N 




SD 


CLASS 
N 


I 


SD 


CLASS 

N 


I 


SD 


1 PRE 
Pfl^T 


— 5 

28 I 


villi 

60.17 


"5.15 

3.37 


4 

21 5 


60.75 
60.20 


4.79 
2.49 


ftn 0 

^ 6 


60.83 
60.50 


4.66 
4.81 


97 12 
27 12 


59.25 
59.75 


5.48 
6.25 


~ PRE 


3? 


57 17 
59.17 


4 58 
2.32 


5 


60 80 
62.00 


3i1 


31 5 


53.50 
62.80 


14.18 
2.68 


26 14 


61.47 
60.57 


2.92 
6.62 


■ , m ' 

ruJi 




fin fi7 
63.17 


If] ni 
5.42 


fi 

29 ; 


60 33 
59.80 


3.83 
2.68 


,n 6 

30 J 


59.17 
60.00 


3.71 
4.90 


^ 13 


58.08 
57,52 


3.37 
10.14 


, PRE 

rUjI 


fi 

22 I 


fil ^1 
61.33 


5 1? 
9.33 


» I 


59 33 
57.33 


2 42 
3.27 


M 5 

2' 6 


58.20 

WW 1 b W 

6PP 


3.49 
1.52 


c 
? 


58.56 
52.89 


7.81 
3.22 


-7 ME 

rUil 


5 

5 


■5 40 

J/ iTV 

58.40 


1 95 

1 1 7 J 

0.85 


fi 

30 ; 


62 50 
57.33 


5 28 
1.68 


0, 6 


60.83 
59.50 


6.01 
5.28 


29 14 


56.00 
57.50 


7.05 
6.30 


, PRE 

^ DHCT 
rUjI 


fi 

30 ; 


fin i^n 
61.80 


? fil 
3:49 


23 I 


59 50 
59.80 


2 51' 
2.68 


6 

29 ; 


60.16 
59.80 


3.37 
4.02 


13 

24 u 


63.00 
62.07 


5.99 
4.46 


7 PRE 

' DHCT 
rUji 


31 ° 


fin 17 

DU. 1/ 

64.00 


? 71 

C,l\ 

5.02 


fi 


55.00 


5 06 
16,86 




61.00 

W 1 i WW 

61, W 


3.46 

5,02, 


r 

32 


62.00 
54.00, 


2.78 
I.JO 


rUol 


6 


W 17 

61.33 


8.45 


1; 

" 6 


fin 40 

58.33 


2 61 

Li U 1 

8.45 


6 


58.83 

Wv t WW 


10.53 

1 W 1 WW 


25 


62.38 
Mi 


4.60 
10.21 


n PRE 

" DflCT 

rUol 




An nn 

DU.UU 

58.33 


D.'tO 

3.88 


fi 


[/J.J J 
54,1/ 


? fin 
/.3! 


23 J 


S8 20 

59.50 


4 02 

T 1 Whi 

Ui 


12 

^" 13 


58.42 
5S.77 


3.75 
1.00 


10 ™^ 

OflCT 
PUbl 




61.60 
59.00 


3.29 
2.45 


32 « 


63.17 
62.8(1 


5.31 
3.42 


^\ 


60.33 

mi 


3.44 


31 9 
8 


56.44 
57.75 


5.22 
7,57 


11 ™^ 

POSl 




51.17 
58.00 


25.79 
0.00 


28 I 


59.17 
63.00 


9.11 
5.18 




57.50 
5/.lf 


0.84 

5,53, 


22 1^ 
^ 1 


59.38 
50,«. 


3.80 
1.13 


POST 


"I 


57.17 
51.00 


9.26 
3,7S 


22 J 


59.83 
60,33 


2.56 
3,S7 




57.67 
5S.5(1 


2.42 
6.68 


21 

^' 15 


61.13 
61.53 


3.92 

in 


TREATHENT PRE 
, EFFECT POST 




59.08 
60.21 


2.97 
1.78 





60.59 
5S.22 


1.33 
2,M 




58.85 
5S.5S 


2.11 
1.81 




59.67 
60.27 


2.31 
2.(19 



TABLE 

Word Association Scale (Attitude Toward Alligators) 
Study II Descriptive Statistics 



m HIGHER 



ECOLOGY 
TEACHER 



TREATMENT II 



50% HIGHER 



COGNITIVE QUESTIONS COGNITIVE' QUESTIONS COGNITIVE QUESTIONS 



TREATMENT II 



TREATMENT II 



m HIGHER 



ART ACTIVITY 
TREATMENT II 




TREATMENT PRE 
EFFECT POST 



Word Association Scale (Attitude Toward Water Pollution) 
Study II Descriptive Statistics 



ECOLOGY 
TE,^,CHER 


25% HIGHER 
COGNITIVE QUESTIONS 
TREATHENT II 


50% HIGHER 
COGNITIVE QUESTIONS 
TREATHENT II 


75% HIGHER 
COGNITIVE QUESTIONS 
TREATHENT II 


ART ACTIVIl 
TREATHENT ] 


fy 

[I , 


ID 


CLASS 

N 




SD 


CLASS 

N 


I 


SO 


CLASS 
N 


il 


SD 


n Apr 

CLASS 

N 


x 


SD 


"* 1 PRE 

POST 


A. 


a.()Q 

60.00 


4.^(5 
3.10 


4 


60.50 
59.20 


10.72 
1.79 


226 


62,83 
60.50 


5.88 
4.fil 




59.9.': 
59.9^ 


6. Ml 

^1 
IJ 

T A)? 

7.24 


rs PRE 

POST 


32 5 


57.33 

59,6/ 


5.99 

X» 


25 \ 


60.40 
63.50 


3.91 
4.85 


31 S 


57,83 
64,00 


3.82 
4.24 


1 r 

< 


61.67 
58.5/' 


. PkE 
POST 


h 


60.67 

63.1/ 


10.01 
5.42 


29 \ 


60.17 
54.00 


4.12 
10.70 




59.50 
58.00 


3.67 
7.59 


1 A 

23^^ 
" 13 


60.75 
56.15 


4.31 

1 A 1 r 

13.15 


k PRE 
POST 




58.50 

%% 


2.26 




57.50 

5/,50 


0.84 
1.22 


'\ 


58.80 
60.00 


?.95 
6.20 


A 

28 ; 


57,55 
60.11 


7.20 

T TA 

7.70 


r PRE 

POST 


23 \ 


62.40 
5S.S0 


8.08 
1.79 


30 I 


62.00 
59,33 


4.90 
0.82 




62.00 
57.50 


3.10 
8.78 


1 h 


56.93 
56.00 


7.13 

T AA 

7.80 


° POST 


A 


61.00 

60. 4() 


3 1 35 
3.29 


23 « 


59.67 
59.00 


5.24 
2.24 


29 « 


60.50 
59.40 


3.99 
2.61 


^ A 

24^ 

14 


60.15 
61.21 


4.00 
4.37 


7 PRE 
POST 


31 « 


60.33 


2.58 

i55 




60.50 

w 


5.50 
16.86 


25 1 


58.75 
61, PO 


3.77 
5.02 


A 

32 \ 


11.67 
3.78 


3.32 

1 AA 

1.99 


0 PRE 
POST 




63.17 
51.3? 


5.31 
/,?/ 


31 5 


61.40 
58,83 


3.97 
7.96 




63.17 
63.33 


5.42 
5.50 


13 


/■A AA 

62.00 
60.15 


4.17 

A 

9.56 


n P5E 

POST 


29 ' 


61.00 


5.02 
9.50 


5 


61.00 
53JI 


3,52 
11. (1. 


23 \ 

D 


60.00 


3.67 


30 ]j 


57.58 
58 23 


5.47 
3.06 


PRE 

0 

POST 




61.60 
5?,00 


3.29 
2,45 


32 ^ 


60.00 
62.20 


5.18 
5.02 




60.33 
60.67 


4.76 
2.80 


31 \ 


54.44 
56.88 


6.73 

1 1 ta 

11.72 


11 

POST 


21 ' 

5 


60.67 
5S.00 


2.50 
2,12 


28 I 


59.83 
63,00 


9.00 
5,9Q 




58.00 
52,6/ 


3.03 
14.40 


22 " 
" 14 


60.00 
60.93 


2.92 
4.84 


12 

POST 


27 j 


58.67 
60.00 


11.71 
2.45 


n \ 


58.83 
59,33 


3.87 

3,9? 




55.50 
55,00 


2.59 
6.51 


21 

15 


60.33 
59.67 


5 69 
7.11 


TREATHENT PRE 
, EFFECT POST 




60.19 
59.91 


1.83 
1.96 




60.15 
58.59 


1.17 
3.34 




59.77 
59.07 


2.21 
3.28 




59.45 
59.15 


2.34 
1.99 



Gall-Crown Discussion Attitude Scale (Attitude toward T^iought tmtUhi} 
Study II Descriptive Statistics 



ECOLOGY 
TEACHER 


25% HIGHER 
COGNITIVE QUESTIONS 
TREATMENT II , 


50"i HIGHER 
COGNITIVE QUESTIONS 
TREATMENT II 


75% HIGHER 
COGNITIVE QUESTIONS 
TREATMENT -11 


ART ACTIVITY 
TREATMENT II 


ID 


CLASS 

N 


I 


SO 


CLASS 

N 


K 


SD 


CLASS 

N 


A 




lASS 

N 


7 

A 




1 PRF 

DELAY 


6 


28.00 
29;'33 


5.18 
3.39 


21 » 

3 


31.40 
30.00 


6.35 
4.58 


22 ^ 
5 


28.17 
30.20 


4.49 
3.49 


2/ " 
I? 


30.09 
31.0fi 


2.84 


T ' PRF 
rKL 

DELAY 


32' 
6 


26.17 
28.50 


6.85 
8.96 


5 


31.00 
31.40 


2.74 
5.27 


31 ' 
6 


25.50 
28,83 


3.27 
4.57 


26 " 

15 


29.00 
29.40 


5.88 
5,37 


3 PRE 

DELAY 


4 


32.25 
30.25 


5.38 
5.12 


6 

29 

5 


30.67 
31.80 


3.44 
4.27 


3»' 
6 


29.50 
30.33 


4.37 
9.00 


23 

14 


29.33 
27.50 


5.07 
8.39 


4 PRE 
DELAY 


6 

22 

6 


25.00 
30.57 


6.87 
5.96 


6 

27 

6 


28.00 
28.00 


6.03 
4.86 


6 

21 . 
'4 


28.50 
28.25 


5.54 
5.06 


9 

28 

8 


28.44 
29.00 


4.80 
5.55 


5 PRE' ' 
DELAY 


6 

23 

6 


30.50 
34.50 


5.35 


■30 

6 


27.67 
30.00 


6.15 
4.00 


6 

24 

6 


29.00 
33.83 


5.48 
8.59 


14 

29 

14 


28.00 
30.43 


5.45 
6.39 


fi DDF 

DELAY • 


6 

30 

6 


28.50 
31.67 


3.27 
5.72 


5 

23 

6 


33.80 
27.33 


4.02 
6.41 


6 

29 

6 


25.83 
32.00 


2.48 

3.8:'; 


12 

24 

13 


27.92 
30.23 


4.46 
4.40 


7 PRF 

/ ri\L 

DELAY 


6 

31 

6 


25.67 
24.83 


3.08 
9.24 


6 

26 

6 


29.67 
35.17 


4.46 
5.27 


6 

25 

6 


32.50 
35.00 


4.6a 
4.05 


9 

32 

8 


30.22 
32.38 


5.B0 
7.13 


S PRF 
DELAY 


6 

26 

6 


27.00 
28.50 


4.90 
3.21 


6 

31 

5 


27.00 
35.00 


5.33 
4.90 


6 

32 

6 


26.50 
30.17 


3.90 
5.67 


13 

25 

12 


33.15 
33.50 


4.95 
6.17 


9 

DELAY 


29 

6 


27.00 
28.67 


4.56 
4.41 


6 

24 

6 


24.67^ 
26.17 


4.59 
6.14 


6 

23 

6 


30.83 


6.01 
8.1?., 


13 

30 

12 


31.08 
23,25, 


3.62 
5,0L 


DDF 

10 

raAY 


6 

25' 

5 


29.83 
30.80 


5.07 
6.26 


6 

32 

6 


30.17 
32.50 


7.17 
6.32 


6 

26 

6 


22.67 
25.83 


4.55 
10.35 


31 ^ 
10 


29.00 


4.03 


PRF ' 

n 

DELAY 


6 

21 

6 


33.00 
34.50 


7.07 
6.41 


5 

28 

5 


26.60 
28.80 


4,88 
5.80 


5 

27 

6 


25.20 
27.83 


5.45 

11,00 


14 

22 

14 


27.14 
27.36 


6.04 
6.42 


PRE 

12 

DELAY 


6 

27 

6 


28.00 
30.00 


2.58 
4.60 


6 

22 

6 


28.17 
26.33 


8.54 
7.79 


5 

28 

5 


27.40 
29.40 


4.22 
3.58 


15 

21 

13 


29.07 
27.92 


5.11 
3.38 


TREATMENT pre 
EFFECT DELAY 




28.41 
30.18 


2.54 
2.65 




29.06 
30.21 


2.51 
3.06 




27.63 

30.16 
— — 


2.70 
2.53 




29.37 
29.62 


1.61 
1 99 



Gall-Crown Discussion Attitude Scale (Attitude toward Discussions) 
Study II Descriptive Statistics 



ECOLOGY 
TEACHER 


25'i HIGHER 
COGNITIVE QUESTIONS 
TREATMENT II 


502 HIGHER 
COGNITIVE QUESTIONS 
TREATMENT II 


75% HIGHER 
COGNITIVE QUESTIONS 
TREATMENT II 


ART ACTIVITY 
TREATi^lENT 11 


ID 


CLASS 


7 

A 


SO 


CLASS 


I 


SD 


CLASS 

N 


I 


SD 


:lass 

N 


I 


SO 


1 PRE 
DELAY 


6 

28 

r 

6 


54.33 
55.67 


8.38 
8.94 


5 

21 

3 


55.80 

/ifl Art 

49.00 


8.53 

IIJo 


6. 

22 

b 


54.50 

00. 40 


4.64 

D J/ 


11 

27 

\L 


55.45 

CO 00 
DO. 00 


6.90 


2 PRE 
DELAY 


32 

6 


52.83 
53.00 


12.95 
10.54 


5 

25 

r 

5 


54.20 
59.40 


6.10 
7.54 


6 

31 

6 


51.50 
48.1/ 


7.01 
7.28 


14 

26 

15 


53.14 

CO CI 

52.0/ 


6.90 


3 PRE 
DELAY 


4 

24 

4 


57.50- 
59.25 


8.10 
3.59 


6 

29 

5 


52.83 
60.60 


4.26 
7.09 


30 

6 


58.50 
57.00 


6.98 

A ir 

9.76 


1^ 

23 

14 


sy.5Q 

49.43 


13.26 


' 4 PRE 

DELAY 


' 6 
22 

§ 


52.83 
55.17 


8.40 
5.95 


6 

27 


51.83 
54.1/ 


10.59 
8.66 


6 

21 

4 


53.67 

51, ?5 


7.66 

5,?? 


9 

28 

? 


49.33 
49,13 


10.19 
7.18 


5 PRE 
DELAY 


6 

23 

6 


59.00 
60,33 


8.48 
10.17 


6 

■30 

6 


60.17 
57.83 


5.71 
5.42 


6 

24 

6 


57.33 
63.33 


9.16 
11.55 


14 

29 

14 


57.00 
5/. /I 


5.95 

0 77 
0.// 


6 PRE 
DELAY 


6 

30 

6 


63.17" 
61.00 


3.97 
10.81 


5 

23 

6 


60.80 
47.17 


5.45 
11.05 


6 

29 

6 


56.6? 
57.67 


5.75 
4.68 


12 

24 

13 


52.S3 

bb.UU 


7.32 

/.Uo 


7 PRE 
DEWY 


6 

31 


53.83 
44.1/ 


8.06 
18.93 


6 

26 

\ 


55.00 
60.33 


6.23 
8.75 


6 

25 

6 


58.33 

fQ,57 


7.55 
5.,!7. 


9 

32 

8 


60.00 
60.00 


6.18 
8.69 


8 PRE 
DELAY 


6 

26 

6 


53.83 
54.17 


, 8.13 
6.64 


6 

31 

5 


50.83 
59.80 


5,42 
6.38 


6 

32 

6 


50.00 
50.33 


10.77 
10.48 


13 

25 

1 A 

12 


57.23 

FA <7 

59.57 


8.79 

1 A AA 

10.08 


PRE 

9 

DELAY 


6 

29 
. 6 


54.17 
51.17 


4.79 
11.77 


'6 

24 

6 


58.67 
55.33 


7.09 
7.09 


6 

23 

6 


54.83 

P P AA 

55.00 


9.66 

1 A AA 

12.00 


13 

30 

1 A 

12 


58.46 
54.00 


6.24 
9.57 


PRE 

10 • 

DELAY 


6 

25 

5 


58.00 
59.40 


4.20 
6.69 


i 

32 

6 


b3.ti3 
57.50 


10.50 


26 

6 


4S.SQ 

48.33 


11.78 


31 

10 


52.li 

50.50 


7.82 
13.57 


PRE 

n 

DELAY 


D 

21 

6 


68.00 


7.04 


28 

5 


54.60 


J* UJ 

3.21 


— T 

27 

6 


'fCo" 

52.00 


1(] 44 
14.13 


14 

22 

14 


51.8b 
50.29 


iBll 
11.19 


PRE 

12 

DELAY 


6 

27 

6 


50.5? 
51.33 


7.97 
6.06 


6 

22 

6 


52.17 
52.50 


8.33 
7.97 


5 

28 

5 


50.40 
52.80 


4.62 
9.36 


15 

21 

13 


52.U0 
52.23 


1^.56 
7.20 


TREATMENT PRE 
EFFECT DELAY 




55.64 


3.46 
5,09 




54.96 

m 


3.29 

'4,^ 




53.35 
54.16 


4.07 
4.74 




54.74 
,52.91 


3.29 
3.86 



TABLE E-28 



Ecology Unit Opinions (Attitude Toward Peers) 
Study 11 Descriptive Statistics 



ECOLOGY 
TEACHER 



1% HIGHER 
COGNITIVE (jUESTIONS 
TREATMENT II 



m HIGHER 
COGNITIVE QUESTIONS 
TREATMENT II 



m HIGHER 
GGNITIVE QUESTIONS 
TREATMENT II 



ART ACTIVITY 
TREATMENT II 




Ecology Unit Opinions (Attitude Toward Ecology Teacher) 
Study H Descriptive Statistics 



ECOLOGY 
TEACHER 


25^ HIGHER 
COGNITIVE (lUESTIOJiS 
TREATMENT II 


50% HIGHER 
COGNITIVE QUESTIONS 
TREATMENT II 


m HIGHER 
COGNITIVE QUESTIONS 
TREATMENT II 


ART ACTIVITY 
TREATMENT II , 


ID 


f*l ACT 

. N 


I 


SD 


1 ACC 

N 


I 


SD 


N 


I 


SD 


N 


I 


SD 


1 Pfl^T 


28 6, 


61.33 


3.44 


21 5 


58.00 


4.85 


22 6 


61.83 


3.12 


27 11 


59.54 


6.07 


1 pn^T 

^ rUOl 


32 6 


60.17 


2.99 


25 6 


56.33 


5.82 


31 6 


60.67 


1.97 


26 15 


56.47 


11.09 


? DflQT 
^ rUol 


24 5 


56.60 


10.26 


29 5 


60.40 


3.36 


30 6 


54.50 


7.04 


23 13 


56.92 


8.58 


4 POQT 
^ rliol 


22 6 


59.83 


5.34 


27 6 


60.67 


2.50 


21 6 


53.17 


9.41 


28 9 


53.44 


7.40 


^ DflQT 


23 5 


57.20 


7.26 


30 5 


58.40 


6.23 


24 6 


61.17 


2.64 


29 13 


61.00 


3.56 




30 i 


59.80 


5.67 


23 5 


60.20 


4.97 


29 4 


59.25 


3.50 


24 13 


56.15 


7.45 


7 DHCT 


31 5 


57.80 


6.61 


26 6 


61.33 


2.34 


25 6 


63.17 


1.17 


32"9 


58.67 


8.54 


ft DHCT 


26 6 


55.83 


9.11 


31 5 


55.60 


15.08 


32 6 


62.50 


2,. 07 


25 12 


61.50 


4.80 




29 6 


51.00 


11.01 


24 5 


52.80 


9.34 


23 6 


49.50 


18.15 


30 13 


53.69 


7.49 


lu POST 


25 6 


59.83 


4.12 


32 6 


57.33 


10.65 


26 6 


58.00 


5.18 


31 11 


52.54 


13.85 


11 POST 


21 6 


61.83 


2.32 


28 6 


58.67 


7.03 


27 6 


57.67 


10.65 


22 15 


57.60 


7.67 


12 POST 


27 6 


55.83 


11.00 


22 6 


57.33 


7.61 


28 6 


51.00 


10.02 


21 15 


58.40 


5.77 


TREATMENT POST 
EFFECT 




58.09 


3.04 




58.09 


2.44 




57.70 


4.63 




,57.16 


2.89 



Ecology Unit Opinions (Attitude Toward Ecology Curriculcm) 
Study II Descriptive Statistics 

^ 



ECOLOGy 
TEACHER 



m HIGHER 



50^ HIGHER 



COGNITIVE QUESTIONS COGNITIVE (JUESTIONS COGNITIVE qUESTIONS 



75!^ HIGHER 
iNITIVE qUE 
TREATMENT II 



ART ACTIVITY 




TABLE E-31 

Ecology Discussion Attitude Scale (Attitude toward Thought (juestions) 
Study II Descriptive Statistics 



... 

ECOLOGY 
TEACHER 


25% HIGHER 
COGNITIVE (jUESTIONS 
TREATMENT II . 


m HIGHER 
COGNITIVE (jUESTIONS 
TREATMENT II 


m HIGHER 
COGNITIVE (jUESTIONS 
TREATMENT II 


ID 


CLASS 

N 


I 


SD 


;lass 

N 


I 


SD 


At 1 A^ 

CLASS 
N 


I 


SD 


1 DACT 


28 6 


35.67 


3.08 


21 5 


35.20 


6.76 


22 6 


36.50 


5.47 


I POST 


32 6 


34.67 


4.37 


25 6 


33.83 


4.36 


31 6 


30.83 


4.17 


0 DACT 

3 POST 


24 5 


31.80 


7.40 


29 5 


34.60 


4.93 


30 6 


30.50 


9.35 


h DACT 

4 POST 


22 6 


32.83 


6.24 


27 6 


32.50 


6.89 


21 6 


33.00 


7.59 


5 POST 


23 6 


34.67 


5.24 


30 6 


36.17 


2.32 


24 6 


35.17 


9.37 


6 POST 


30 5 


36.20 


4.76 


23 5 


25.80 


15.02 


29 5 


32.40 


3.51 


/ POST 


31 6 


29.17. 


9.26 


26 6 


35.00 


4.56 


25 6 


39.00 


4.15 


0 riAf*T 

8 POST 


26 6 


33 33 


5.57 


31 6 


35.50 


7.12 


32 6 


32.00 


4.. 73 


9 POST 


29 6 


25.83 


•3.19 


24 6 


22.83 


9.13 


23 6 


31.50 


10.65 


10 POST 


25 6 


36.67 


6.56 


32 5 


33.60 


6.58 


26 6 


30.67 


6.74 


11 POST 


21 5 


35.60 


6.69 


28 6 


31.50 


2.26 


27 6 


31.17 


7.81 


12 POST 


27 6 


32.67 


3.83 


22 6 


31.33 


6.71 


28 6 


31.33 


4.18 


TREATMENT POST 
EFFECT 




33.25 


3.16 




32.32 


4.09 




32.92 


2.66 



TA3LE E-32 

Ecology Discussion Attitude Scale (Attitude toward Discussion) 
Study II Descriptive Statistics 



ECOLOGY 
TEACHER 


2531 HIGHER 
COGNITIVE dOESTIONS 
TREATMENT II 


m HIGHER 
COGNITIVE JOESTIONS 
TREATHENT II 


75^ HIGHER 
COGNITIVE dUESTIONS 
TREATMENT II 


ID 


CLASS 

N 


X 


SO 


lASS 

N 


I 


SO 


CLASS 
N 


X 


SO 


.1 r UJ I 


28 6 


64.33 


6.68 


21 5 


60.60 


12.42 


22 6 


65.67 


8.76 


0 nncT 


32 6 


•62.33 


4.08 


25 6 


62.67 


5.72 


31 6 


58.00 


4.20 




24 5 


55.60 


8.26 


29 5 


56.00 


9.35 


30 6 


57.17 


11.48 


J nAPT 

4 POST 


22 6 


58.33 


7.97 


27 6 


63.17 


7.81 


21 6 


59.50 


9.42 


5 POST 

! 


23 6 


63.00 


7.35 


30 6 


62.67 


7.97 


24 6 


63.67 


• 9.56 


1 

6 POST 

i 


30 5 


62.00 


6.32 


23 5 


53.40 


.. 3.21 


.29 5 


58.00., 


6.52 


/ POST 


31 6 


56.33 


11.81 


26 6 


63.17 


6.74 


25 6 


67.00 


4.73 


8 POST 


26 6 


59.50 


7.42 


31 6 


64.50 


9.33 


32 6 


60.00 


8,50 


9 POST 


29 6 


47.00 


9.10 


24 6 


49.33 


13.63 


23 6 


55.83 


15.85 


10 POST 


25 6 


66. pO 


5.40 


32 5 


59.40 


8.96 


26 6 


47.50 


25.69 


11 POST 


21 5 


69.60 


5.08 


28 6 


59.17 


3.49 


27 6 


59.33 


10.11 


12 ■ POST 


27 6 


56.83 


5.53 


22 6 


60.00 


9.72 


28 6 


54.83 


8.06 


TREATHENT POST 
EFFECT 




60.07 


5.88 




59.50 


4.54 




58.87 


5.19 



TABLE E-33 

Ecology Art Project Scale (Attitude toward Art Projects) 
Study 11 Descriptive Statistics 



ECOLOGY 
TEACHER 


ART ACTIVn 
TREATMENT 1 


'Y 

rr 
i 


ID 


CLASS 

N 


J 




1 POST 


27 12 


69.00 


7 14 

/•IT 


2 POST 


26 14 


61.93 


9 59 




23 13 


61.62 


15 42 


4 POST 


28 9 


58.67 


9.27 




29 13 


63.92 


8.98 




0 r 1 


— 

24 12 


61.92 


8.24 


7 POST 


32-7 


-67t43 


-6- 50- 


fl DACT 

0 rUol 


25 12 


72.17 


2.59 


9 POST 


30 13 


59.69 


10.51 


10 POST 


31 n 


58.27 


10.62 


n POST 


22 15 


63.00 


10.34 


12 POST 


21 13 


62.77 


9.32 


TREATMENT POST 
EFFECT 




63.36 


4.21 



ERIC 



414 



TABLE E-34 

Number of Treatment Sessior:,; Attended 
Study II Descriptive Statistics 



ECOLOGY 
TEACHER 


25^ HIGHER 
COGNITIVE OUESTIONS 
TREATMENT II 


50^ HIGHER 
COGNITIVE QUESTIONS 
TREATMENT II 


75^ HIGHER 
COGNITIVE dUESTIONS 
TREATMENT II 


ART ACTIVIl 
TREATMENT 1 


ru 

fy 

[I , 


ID 


CLASS 

N 


I 


SO 


cUss 

N 


)( 


SD 


CLASS 


7 

A 


cn 


CLASS 

N 


7 

h 


SD 


1 


28 


,9.17 


0.98 


01 5 


8.60 


1.34 


00 j 
LL 


8.17 


2.23 


2/12 

LI 


9.83 


0.39 


2 


to 6 
32 


10.00 


0.00 


OC 0 


9.67 


0.82 


j1 


9.83 


0.41 




10.00 


0.00 


3 


24 


9.50 


0.84 


00 6 


8.67 


1.21 


in ^ 


9.33 


1.21 


23 '4 

CO 


10.00 


0.00 


4 


22 " 


9.33 


1.21 


2/ 


8.00 


3.63 


01 6 


9.33 


0.82 


40 


8.56 


1.51 


5 


n't b 

23 " 


9.50 


0.55 


30 


9.67 


0.82 


24 


9.67 


0.82 


29 14 


9.78 


0.42 


6 


30 


8.50 


3.21 


00 6 


9.33 


1.03 




i — 
9.17 


1.33 




9.27 


1.27 


7 


31 ° 


9 17 

•/lit 


0.75 


26 


9.33 


0.52 


Zd 


9.50 


0.55 


00 9 


9.44 


0.88 


8 


26 ^ 


•9.50 


0.84- 


31 ^ 


9.33 


i-.2r- 


32 ^ 


"9:50 


"0.55" 




"9.67 


0.89 


9 


29 ^ 


9.60 


0.55 


24 ^ 


9.83 


0.4i 


23 


S.17 


0.75 


30 


9.92 


0.28 


10 


25 ^ 


9.17 


0.98 


32 ^ 


9.50 


0.55 


26 ^ 


8.50 


1.52 


31 11 


9.00 


2.72 


II 


21 ^ 


9.83 


0.41 


28 ^ 


8.50 


2.51 


27 ^ 


9.00 


1.55 


22 15 


9.73 


0.59 


12 


27 ^ 


9.17 


1.17 


22 ^ 


9.83 


0.41 


28 ^ 


B.83 


1.60 


2,15 


8.73 


1.49 


TREATMENT 
EFFECT 




9.37 


0.39 




9.18 


0.60 




9.16 


0.48 




9.49 


0.50 



